-- Logs begin at Tue 2022-06-21 07:33:05 UTC, end at Tue 2022-06-21 08:39:10 UTC. -- Jun 21 08:06:54.482219 dv-cinder-836973-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 08:06:54.491381 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 08:06:54 2022] *** Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: nodename: dv-cinder-836973-7-iscsi Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: machine: x86_64 Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: clock source: unix Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: pcre jit disabled Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: detected number of CPU cores: 4 Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: current working directory: / Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: detected binary path: /usr/bin/uwsgi-core Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: your processes number limit is 47680 Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: your memory page size is 4096 bytes Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: detected max file descriptor number: 2048 Jun 21 08:06:54.493333 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: lock engine: pthread robust mutexes Jun 21 08:06:54.494297 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: thunder lock: enabled Jun 21 08:06:54.494297 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 08:06:54.494297 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 08:06:54.537483 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: Python main interpreter initialized at 0x56181792e9c0 Jun 21 08:06:54.537483 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: python threads support enabled Jun 21 08:06:54.537483 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: your server socket listen backlog is limited to 100 connections Jun 21 08:06:54.537483 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: your mercy for graceful operations on workers is 90 seconds Jun 21 08:06:54.537909 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 08:06:54.537909 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: *** Operational MODE: preforking *** Jun 21 08:06:54.538182 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: *** uWSGI is running in multiple interpreter mode *** Jun 21 08:06:54.538182 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: spawned uWSGI master process (pid: 103197) Jun 21 08:06:54.538399 dv-cinder-836973-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 08:06:54.539595 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: spawned uWSGI worker 1 (pid: 103198, cores: 1) Jun 21 08:06:54.539595 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: spawned uWSGI worker 2 (pid: 103199, cores: 1) Jun 21 08:06:54.539595 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 08:06:55.207745 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 08:06:55.209854 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 08:06:56.335729 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:06:56.335729 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: from cryptography.utils import int_from_bytes Jun 21 08:06:56.336359 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:06:56.336359 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: from cryptography.utils import int_from_bytes Jun 21 08:06:56.338082 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:06:56.338082 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: from cryptography.utils import int_from_bytes Jun 21 08:06:56.338498 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:06:56.338498 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: from cryptography.utils import int_from_bytes Jun 21 08:06:58.838849 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 08:06:58.839471 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 08:06:58.839825 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 08:06:58.839912 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 08:06:58.839998 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 08:06:58.840092 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 08:06:58.840183 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 08:06:58.840271 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 08:06:58.840349 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 08:06:58.840440 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 08:06:58.840523 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.840607 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.840819 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.840917 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.841141 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.841243 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.841461 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.841557 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.841796 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.841882 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.842106 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.842198 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.842427 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.842511 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.842772 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.842859 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.843103 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.843186 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.843365 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.843450 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.843680 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.843764 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.844007 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-7-iscsi {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.844101 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-7-iscsi {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.844328 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.844412 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.844634 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.844723 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.844942 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.845037 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.845317 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.845415 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.845625 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.845719 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.845948 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.846039 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.846256 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.846339 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.846772 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.846889 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.847209 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.847328 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.847516 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.847641 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.847833 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.847961 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.848166 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.848301 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.848481 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.848566 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.848789 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.848881 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.849109 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.849198 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.849415 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.849506 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.849738 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.849880 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.850046 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.850137 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.850442 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-7-iscsi {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.850533 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-7-iscsi {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.850799 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.850928 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.851101 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.851194 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.851416 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.851505 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.851826 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.851924 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.852138 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.852291 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.852447 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.852531 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.852769 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.852893 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.853091 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.853176 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.853400 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.853525 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.853725 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.853810 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.854045 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.854138 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.854363 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.854447 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.854705 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.854803 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.855010 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.855101 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.855316 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.855408 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.855622 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.855713 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.855945 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.856028 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.856248 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.856339 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.856551 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.856635 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.856799 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.856894 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.857104 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.857200 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.857424 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.857508 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.857744 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.857833 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.858064 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.858169 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.858316 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.858401 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.858563 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.858680 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.858917 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.859243 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.859355 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.859553 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.859649 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.859862 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.859948 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.860170 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.860255 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.860478 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.860569 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.861302 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.861446 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.861608 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.861707 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.861914 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.862008 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.862223 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.862315 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.862544 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.862669 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.863149 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.863249 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.863472 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.863592 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.863780 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.863875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.864101 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.864195 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.864424 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.864507 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.864737 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.864827 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.865047 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.865140 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.865362 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.865445 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.865692 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.865777 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.866004 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.866166 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.866318 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.866407 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.866678 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.866776 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.866971 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.867065 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.867280 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.867369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.867584 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.867667 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.867890 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.867975 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.868212 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.868296 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.868515 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.868598 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.868770 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.868855 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.869072 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.869163 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.869374 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.869456 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.869681 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.869775 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.869983 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.870073 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.870291 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.870375 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.870594 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.870755 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.870917 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.871001 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.871225 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.871318 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.871530 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.871616 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.871834 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.871917 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.872135 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.872225 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.872440 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.872524 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.872742 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.872833 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.873048 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.873139 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.873351 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.873435 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.873655 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.873738 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.873962 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.874054 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.874278 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.874367 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.874586 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.874704 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.874924 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.875029 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.875220 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.875303 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.875523 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.875607 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.875827 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.875919 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.876139 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.876224 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.876994 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.877089 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.877322 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.877438 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.877631 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.877768 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.877938 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.878081 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.878259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.878393 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.878571 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.878743 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.878917 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.879056 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.879238 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.879366 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.879541 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.879689 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.879850 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.879993 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.880170 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.880305 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.880481 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.880629 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.880788 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.880939 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.881094 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.881249 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.881397 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.881555 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.881701 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.881861 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.882007 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.882169 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.882310 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.882476 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.882612 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.882809 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.882930 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.883116 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.883248 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.883419 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.883569 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.883740 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.883883 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.884064 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.884191 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.884377 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.884496 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.884688 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.884816 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.884995 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.885150 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.885318 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:06:58.885484 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.885656 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.885831 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.885991 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.886154 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.886345 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.886490 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.886685 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.886858 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.887027 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.887178 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.887365 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.887492 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.887687 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.887793 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.888004 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.888119 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.888319 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.888432 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.888649 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.888735 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.888965 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.889049 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.889279 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.889373 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.889592 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.889683 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.889912 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.890087 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.890232 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.890334 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.890562 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.890660 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.890902 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.890986 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.891215 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.891313 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.891532 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.891656 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.891847 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.891939 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.892221 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.892630 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.892735 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.893114 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.893333 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.893465 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.893791 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.893925 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.894121 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.894207 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.894449 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.894795 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.895113 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.895428 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.895753 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.895837 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.896092 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.896256 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.896407 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.896598 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.896727 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.897028 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.897113 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.897340 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.897489 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.897652 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.897966 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.898058 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.898278 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.898636 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.898725 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.898951 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.899217 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.899400 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.899568 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.899663 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.899884 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.899980 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.900198 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.900284 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.900510 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.900604 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.900822 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.900908 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.901129 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.901225 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.901437 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.901523 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.901746 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.901831 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.902058 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.902144 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.902363 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.902449 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.902714 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.902814 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.903050 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.903135 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.903360 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.903447 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.903696 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.903781 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.904007 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.904099 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.904321 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.904407 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.904634 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.904725 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.904943 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.905026 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.905252 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.905427 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.905565 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.905743 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.905882 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.906063 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.906189 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.906375 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.906515 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.906728 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.906857 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.907068 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.907154 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.907384 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.907468 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.907763 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.907888 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.908101 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.908389 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.908475 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.908728 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.908982 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.909102 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.909342 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.909530 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.909657 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.909929 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.910024 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.910256 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.910342 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.910579 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.910685 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.910918 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.911002 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.911229 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.911315 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.911552 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.911637 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.911861 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.911952 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.912172 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.912258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.912491 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.912575 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.912805 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.912902 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.913122 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.913208 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.913437 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.913522 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.913754 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.913852 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.914066 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.914197 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.914377 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.914462 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.914709 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.914816 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.915021 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.915114 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.915338 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.915424 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.915648 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.915743 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.915965 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.916063 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.916275 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.916368 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.916584 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.916670 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.916894 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.916978 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.917209 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.917293 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.917516 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.917613 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.917820 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.917905 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.918124 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.918209 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.918428 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.918520 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.918755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.918833 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.919066 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.919163 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.919376 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.919464 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.919682 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.919774 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.919990 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.920083 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.920319 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.920453 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.920631 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.920717 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.920938 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.921032 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.921243 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.921330 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.921548 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.921635 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.921870 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.922007 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.922184 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.922270 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.922506 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.922599 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.922844 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.922945 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.923167 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.923814 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.924034 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.924127 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.924354 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.924515 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.924677 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.924838 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.924995 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.925166 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.925313 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.925481 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.925631 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.925804 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.925947 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.926150 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.926273 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.926496 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.926581 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.926845 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.926943 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.927175 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.927270 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.927493 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.927577 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.927811 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.927896 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.928125 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.928218 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.928440 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.928525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.928754 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.928838 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.929071 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.929168 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.929392 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.929476 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.929707 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.929800 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.930031 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.930117 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.930343 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.930427 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.930683 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.930771 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.931000 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.931086 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.931310 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.931395 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.931615 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.931707 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.931926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.932018 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.932248 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.932334 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.932563 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.932647 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.932877 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.932973 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.933188 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.933282 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.933508 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.933601 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.933820 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.933912 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.934130 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.934215 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.934438 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.934536 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.934768 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.934891 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.935078 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.935163 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.935390 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.935484 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.935708 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.935800 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.936021 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.936106 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.936340 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.936439 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.936649 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.936735 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.936961 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.937052 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.937269 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.937369 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.937573 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.937664 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.937875 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.937958 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.938187 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.938272 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.938501 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.938592 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.938860 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.939451 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.939755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.939836 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.940074 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.940187 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.940389 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.940476 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.940702 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.940788 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.941013 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.941106 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.941324 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.941417 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.941640 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.941725 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.941951 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.942034 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.942257 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.942356 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.942582 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.942712 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.942927 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.943021 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.943235 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.943332 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.943546 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.943632 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.943865 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.943956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.944176 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.944268 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.944485 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.944570 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.944794 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.944878 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.945100 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.945184 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.945421 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.945505 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.945739 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.945824 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.946045 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.946130 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.946359 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.946443 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.946700 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.946801 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.947017 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.947113 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.947324 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.947408 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.947634 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.947717 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.947945 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.948030 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.948256 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.948340 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.948566 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.948664 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.948875 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.948967 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.949186 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.949277 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.949501 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.949657 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.949817 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.950071 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.950164 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.950408 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.950493 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.950754 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.950965 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.951063 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.951293 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.951379 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.951610 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.951708 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.951921 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.952007 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.952236 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.952321 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.952557 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.952646 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.952950 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.953127 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.953266 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.953463 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.953576 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.953782 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.953883 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.954106 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.954192 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.954428 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.954581 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.954823 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.954933 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.955161 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.955236 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.955494 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.955578 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.955798 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.955883 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.956114 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.956217 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.956421 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.956507 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.956729 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.956823 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.957038 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.957123 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.957341 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.957433 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.957650 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.957748 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.957953 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.958037 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.958265 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.958351 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.958573 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.958721 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.958905 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.958990 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.959212 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.959297 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.959518 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.959609 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.959827 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.959911 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.960147 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.960232 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.960457 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.960543 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.960773 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.960867 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.961081 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.961166 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.961409 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.961496 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.961713 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.961803 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.962016 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.962102 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.962325 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.962411 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.962641 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.962738 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.962957 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.963055 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.963269 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.963354 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.963579 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.963665 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.963885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.963978 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.964196 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.964282 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.964506 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.964592 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.964816 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.964914 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.965125 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.965211 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.965428 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.965517 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.965736 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.965829 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.966041 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.966124 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.966354 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.966438 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.966688 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.966788 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.966994 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.967080 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.967300 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.967393 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.967609 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.967702 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.967915 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.968000 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.968216 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.968300 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.968519 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.968604 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.968820 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.968904 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.969124 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.969208 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.969429 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.969514 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.969735 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.969821 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.970038 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.970147 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.970372 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.970459 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.970727 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.970824 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.971013 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.971113 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.971316 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.971400 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.971627 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.971712 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.971933 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.972027 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.972235 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.972319 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.972544 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.972635 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.972849 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.972941 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.973152 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.973236 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.973458 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.973542 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.973767 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.973854 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.974073 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.974159 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.974377 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.974462 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.974716 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.974806 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.975025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.975123 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.975330 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.975460 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.975635 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.975728 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.975940 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.976023 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.976246 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.976330 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.976550 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.976637 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.976854 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.976939 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.977159 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.977253 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.977466 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.977558 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.977776 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.977859 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.978083 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.978175 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.978389 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.978474 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.978717 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.978804 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.979021 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.979117 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.979325 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.979409 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.979633 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.979729 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.979940 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.980034 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.980250 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.980336 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.980558 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.980650 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.980885 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.980972 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.981192 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.981287 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.981496 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.981580 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.981804 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.981891 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.982104 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.982188 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.982419 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.982504 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.982757 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.982847 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.983072 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.983157 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.983376 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.983461 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.983681 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.983768 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.984004 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.984089 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.984315 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.984399 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.984622 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.984707 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.984936 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.985027 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.985245 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.985338 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.985565 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.985657 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.986439 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.986718 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.986803 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.986889 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.987074 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.987168 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.987385 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.987473 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.988011 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.988159 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.988297 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.988383 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.988610 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.988696 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.988924 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.989238 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.989323 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.989552 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.989637 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.989859 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.989944 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.990163 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.990248 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.990472 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.990563 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.990810 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.990899 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.991118 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.991210 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.991429 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.991520 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.991740 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.991831 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.992045 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.992131 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.992355 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.992440 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.992657 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.992756 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.992965 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.993049 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.993268 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.993360 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.993578 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.993697 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.993974 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.994060 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.994293 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.994390 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.994599 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.994746 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.994930 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.995017 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.995241 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.995334 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.995553 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.995682 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.995856 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.995940 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.996158 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.996255 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.996463 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.996578 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.996888 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.996979 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.997196 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.997291 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.997506 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.997590 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.997807 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.997899 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.998114 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.998201 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.998424 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.998509 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.998764 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.998851 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.999070 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.999163 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.999375 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.999468 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.999681 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:58.999790 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.000005 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.000091 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.000312 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.000404 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.000634 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.000728 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.000994 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.001078 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.001304 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.001951 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.002289 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.002385 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.002634 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.002752 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.002960 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.003071 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.003271 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.003390 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.003581 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.003717 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.003911 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.004043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.004223 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.004386 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.004551 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.004667 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.004974 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.005099 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.005283 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.005369 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.005591 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.005682 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.005920 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.006011 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.006231 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.006338 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.006555 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.006660 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.006888 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.006975 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.007215 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.007301 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.007541 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.007627 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.007857 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.007943 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.008180 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.008265 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.008501 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.008586 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.008829 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.008927 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.009158 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.009243 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.009476 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.009562 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.009794 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.009886 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.010102 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.010205 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.010419 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.010511 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.010762 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.010852 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.011074 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.011172 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.011385 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.011471 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.011711 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.011804 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.012021 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.012115 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.012334 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.012420 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.012646 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.012733 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.012958 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.013051 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.013264 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.013357 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.013571 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.013656 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.013896 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.013983 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.014202 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.014295 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.014515 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.014600 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.014854 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.014945 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.015181 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.015267 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.015507 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.015593 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.015816 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.015903 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.016132 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.016216 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.016440 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.016534 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.016750 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.016836 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.017085 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.017177 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.017392 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.017522 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.017722 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.017811 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.018030 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.018115 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.018352 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.018452 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.018698 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.018787 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.019013 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.019098 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.019332 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.019430 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.019642 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.019727 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.019953 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.020038 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.020263 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.020360 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.020570 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.020656 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.020905 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.020990 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.021214 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.021306 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.021517 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.021602 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.021829 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.021915 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.022136 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.022223 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.022443 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.022537 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.022774 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.022862 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.023088 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.023175 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.023394 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.023480 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.023703 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.023789 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.024009 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.024102 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.024335 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.024421 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.024643 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.024735 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.024957 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.025050 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.025265 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.025350 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.025571 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.025663 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.025876 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.026009 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.026181 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.026268 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.026485 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.026587 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.026832 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.026919 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.027142 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.027227 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.027471 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.027568 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.027783 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.027876 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.028107 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.028192 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.028419 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.028505 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.028723 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.028808 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.029033 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.029118 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.029340 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.029433 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.029653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.029737 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.029970 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.030063 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.030286 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.030373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.030605 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.030763 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.030945 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.031031 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.031257 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.031343 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.031574 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.031658 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.031888 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.031981 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.032204 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.032299 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.032519 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.032842 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.032996 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.033181 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.033275 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.033500 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.033585 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.033815 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.033908 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.034129 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.034222 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.034438 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.034523 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.034779 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.034868 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.035097 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.035184 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.035412 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.035498 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.035729 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.035934 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.036062 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.036269 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.036355 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.036590 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.036676 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.036909 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.036996 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.037226 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.037319 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.037545 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.037631 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.037864 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.037951 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.038187 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.038273 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.038502 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.038596 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.038842 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.038929 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.039159 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.039245 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.039490 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.039590 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.039810 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.039898 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.040130 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.040216 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.040449 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.040535 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.040763 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.040849 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.041075 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.041161 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.041390 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.041476 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.041701 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.041785 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.042013 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.042098 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.042325 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.042419 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.042659 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.042759 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.042979 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.043077 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.043303 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.043388 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.043621 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.043706 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.043936 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.044093 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.044248 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.044334 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.044562 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.044663 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.044875 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.044967 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.045185 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.045393 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.045517 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.045710 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.045805 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.046048 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.046169 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.046380 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.046474 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.046743 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.046845 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.047065 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.047158 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.047381 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.047467 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.047703 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.047800 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.048010 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.048096 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.048927 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.049067 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.049241 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.049499 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.049593 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.049848 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.049941 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.050170 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.050267 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.050483 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.050569 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.050816 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.050905 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.051140 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.051239 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.051451 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.051545 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.051781 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.051984 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.052095 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.052334 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.052420 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.052655 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.052741 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.052988 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.053082 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.053320 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.053413 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.053633 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.053718 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.053938 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.054033 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.054258 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.054349 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.054563 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.054681 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.054897 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.055122 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.055210 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.055475 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.055557 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.055799 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.055893 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.056103 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.056188 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.056417 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.056503 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.056729 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.056823 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.057040 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.057127 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.057354 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.057441 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.057661 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.057755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.057969 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.058053 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.058278 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.058364 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.058586 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.058747 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.058917 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.059013 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.059227 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.059312 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.059530 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.059623 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.059838 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.059924 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.060145 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.060229 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.060447 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.060533 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.060756 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.060849 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.061059 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.061143 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.061369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.061462 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.061674 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.061759 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.061982 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.062069 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.062284 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.062369 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.062593 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.062738 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.062926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.063011 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.063238 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.063324 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.063549 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.063633 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.063882 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.063977 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.064212 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.064297 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.064525 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.064712 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.064849 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.065031 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.065163 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.065349 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.065474 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.065662 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.065818 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.065978 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.066137 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.066335 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.066688 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.066785 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.067005 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.067104 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.067317 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.067403 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.067639 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.067724 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.067955 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.068050 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.068276 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.068367 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.068587 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.068673 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.068896 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.068990 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.069220 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.069308 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.069534 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.069619 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.069847 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.070067 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.070160 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.070410 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.070496 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.070772 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.070871 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.071081 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.071178 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.071391 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.071478 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.071702 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.071789 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.072011 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.072096 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.072320 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.072407 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.072632 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.072719 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.072942 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.073028 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.073252 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.073337 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.073563 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.073649 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.073877 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.073961 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.074192 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.074352 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.074506 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.074598 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.074844 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.074929 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.075158 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.075258 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.075465 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.075551 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.075772 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.075857 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.076081 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.076174 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.076387 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.076515 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.076694 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.076779 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.077013 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.077099 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.077331 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.077424 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.077639 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.077725 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.077966 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.078052 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.078283 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.078368 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.078603 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.078710 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.078943 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.079030 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.079257 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.079341 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.080089 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.080196 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.080543 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.080629 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.080864 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.080949 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.081191 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.081285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.081505 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.081590 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.081814 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.081906 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.082165 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.082258 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.082498 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.082584 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.082876 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.082972 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.083185 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.083271 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.083494 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.083579 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.083802 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.083888 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.084114 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.084201 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.084429 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.084514 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.084737 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.084821 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.085043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.085129 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.085349 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.085435 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.085659 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.085752 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.085966 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.086059 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.086274 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.086359 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.086580 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.086693 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.086910 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.087003 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.087223 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.087315 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.087527 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.087621 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.087837 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.087926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.088142 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.088227 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.088444 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.088540 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.088745 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.088831 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.089093 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.089192 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.089359 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.089446 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.089659 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.089751 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.089964 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.090057 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.090264 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.090350 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.090569 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.090719 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.090899 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.090983 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.091206 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.091292 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.091513 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.091605 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.091819 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.091904 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.092126 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.092213 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.092432 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.092518 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.092741 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.092834 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.093047 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.093132 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.093355 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.093441 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.093660 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.093754 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.093966 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.094051 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.094270 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.094355 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.094599 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.094716 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.094934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.095041 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.095341 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.095459 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.095791 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.095885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.096109 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.096195 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.096436 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.096521 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.096746 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.096831 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.097071 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.097162 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.097399 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.097490 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.097713 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.097801 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.098023 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.098107 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.098351 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.098436 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.098684 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.098774 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.099002 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.099089 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.099313 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.099406 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.099624 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.099718 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.099937 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.100023 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.100243 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.100335 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.100560 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.100646 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.100871 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.100958 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.101181 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.101278 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.101496 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.101581 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.101814 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.101907 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.102130 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.102216 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.102449 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.102535 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.102784 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.102881 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.103115 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.103201 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.103431 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.103516 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.103745 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.103839 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.104064 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.104152 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.104375 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.104460 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.104688 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.104780 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.105007 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.105094 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.105320 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.105412 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.105627 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.105721 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.105873 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 08:06:59.105960 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.106262 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.106593 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.106950 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.107303 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.107620 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.107967 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.108299 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.108620 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.108935 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.109246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:06:59.109495 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 08:06:59.261615 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Registered counter for database nova_api Jun 21 08:06:59.264777 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO dbcounter [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Registered counter for database nova_api Jun 21 08:06:59.283899 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:06:59.285577 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_db.sqlalchemy.engines [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:06:59.290583 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:06:59.292059 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writer thread running {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:06:59.348524 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.context [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad5ffcf-142b-4048-bb9c-97a48bfdc94c(cell1) {{(pid=103198) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 08:06:59.349234 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.context [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad5ffcf-142b-4048-bb9c-97a48bfdc94c(cell1) {{(pid=103199) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 08:06:59.352406 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:06:59.353127 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:06:59.354014 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:06:59.354725 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:06:59.354835 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:06:59.355521 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:06:59.356791 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:06:59.357487 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:06:59.358786 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Registered counter for database nova_cell0 Jun 21 08:06:59.359475 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO dbcounter [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Registered counter for database nova_cell0 Jun 21 08:06:59.363728 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Registered counter for database nova_cell1 Jun 21 08:06:59.364404 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO dbcounter [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Registered counter for database nova_cell1 Jun 21 08:06:59.370944 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:06:59.373565 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:06:59.374679 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_db.sqlalchemy.engines [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:06:59.377854 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_db.sqlalchemy.engines [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:06:59.378724 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:06:59.381165 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writer thread running {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:06:59.383961 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:06:59.520790 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writer thread running {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:06:59.530565 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO dbcounter [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Registered counter for database nova_cell0 Jun 21 08:06:59.531973 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Registered counter for database nova_cell0 Jun 21 08:06:59.538313 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_db.sqlalchemy.engines [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:06:59.541838 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:06:59.542841 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writer thread running {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:06:59.546120 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:06:59.885282 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 08:06:59.885949 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: WARNING keystonemiddleware.auth_token [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 08:06:59.892695 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 08:06:59.893181 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: WARNING keystonemiddleware.auth_token [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 08:07:00.230524 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 08:07:00.232315 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: WARNING keystonemiddleware.auth_token [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 08:07:00.236720 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 08:07:00.238821 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: WARNING keystonemiddleware.auth_token [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 08:07:00.242130 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56181792e9c0 pid: 103198 (default app) Jun 21 08:07:00.244030 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56181792e9c0 pid: 103199 (default app) Jun 21 08:07:00.244204 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:07:00.245373 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-5d3f4af1-f1ca-43fd-b433-a4f884fb1ec6 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001728 Jun 21 08:07:00.245781 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Tue Jun 21 08:07:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:15.693433 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:15.694690 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Jun 21 08:08:15.695103 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:15.711194 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=3 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:15.712757 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell1:SELECT=3 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:15.713669 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell0:SELECT=3 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:15.714588 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:16.147001 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-c79a4393-ce37-4674-8d15-7a0a8fe93293 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:16.177215 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-c79a4393-ce37-4674-8d15-7a0a8fe93293 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476169 Jun 21 08:08:16.177744 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 21 08:08:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:08:18.278547 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:18.279656 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-0c901134-f87e-4ffd-98ad-0f5f462ee96c None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jun 21 08:08:18.280058 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:18.344831 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-619d0e25-a7f5-4817-8b9c-235945410d83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:18.363526 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:08:18.363526 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: warnings.warn(msg) Jun 21 08:08:18.396477 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-619d0e25-a7f5-4817-8b9c-235945410d83 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107957 Jun 21 08:08:18.398826 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 08:08:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:08:18.624793 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-f4f17e38-3a63-4863-91be-47b10ab6ce7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:18.627144 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:08:18.627144 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: warnings.warn(msg) Jun 21 08:08:18.629818 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_api:SELECT=3 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:18.630778 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_cell0:SELECT=3 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:18.631586 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_cell1:SELECT=3 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:18.632285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:18.696439 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-f4f17e38-3a63-4863-91be-47b10ab6ce7c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290226 Jun 21 08:08:18.711805 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 21 08:08:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:08:20.819753 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-619d0e25-a7f5-4817-8b9c-235945410d83 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:20.820760 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-619d0e25-a7f5-4817-8b9c-235945410d83 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 21 08:08:20.821429 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:20.933675 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-0a042e4a-b945-4e5f-b6ef-0387a76b8815 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:20.955263 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:08:20.955263 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: warnings.warn(msg) Jun 21 08:08:20.984161 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-0a042e4a-b945-4e5f-b6ef-0387a76b8815 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156710 Jun 21 08:08:20.984829 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 08:08:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:08:20.998050 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-775b586d-fa3c-4908-81f2-8572feafc06d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:20.999554 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:08:20.999554 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: warnings.warn(msg) Jun 21 08:08:21.033092 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-775b586d-fa3c-4908-81f2-8572feafc06d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038785 Jun 21 08:08:21.033928 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 21 08:08:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:08:23.139994 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-0a042e4a-b945-4e5f-b6ef-0387a76b8815 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:23.141199 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-0a042e4a-b945-4e5f-b6ef-0387a76b8815 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Jun 21 08:08:23.141716 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:23.203862 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-86dae7b6-b9c8-4fef-b33f-1cedbd0ca734 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "ram": 1024}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:23.223182 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-86dae7b6-b9c8-4fef-b33f-1cedbd0ca734 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075665 Jun 21 08:08:23.223730 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 08:08:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:08:23.235671 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-6df6bff0-7c1e-4d91-9fd5-8686d3ae6b4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:23.259647 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-6df6bff0-7c1e-4d91-9fd5-8686d3ae6b4a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027862 Jun 21 08:08:23.270644 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 21 08:08:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:08:25.367017 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-86dae7b6-b9c8-4fef-b33f-1cedbd0ca734 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:25.368062 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-86dae7b6-b9c8-4fef-b33f-1cedbd0ca734 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 21 08:08:25.368454 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:25.427636 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-1e56e7c2-9795-40db-813f-5f7054055d89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "ds2G", "id": "d3"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:25.444973 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-1e56e7c2-9795-40db-813f-5f7054055d89 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070967 Jun 21 08:08:25.445538 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 08:08:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:08:25.457365 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ebcd97c4-6918-4d90-bfa0-9955e0e5e58a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:25.479687 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-ebcd97c4-6918-4d90-bfa0-9955e0e5e58a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026220 Jun 21 08:08:25.480334 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 21 08:08:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:08:27.566123 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-1e56e7c2-9795-40db-813f-5f7054055d89 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:27.567694 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-1e56e7c2-9795-40db-813f-5f7054055d89 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 Jun 21 08:08:27.568511 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:27.629802 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-91330aa5-d41b-4da8-9b10-69e5cd056b44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "vcpus": 4, "ram": 4096, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:27.647690 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-91330aa5-d41b-4da8-9b10-69e5cd056b44 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072883 Jun 21 08:08:27.648285 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 08:08:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:08:27.662362 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-7a300d22-9da9-4da2-931e-47e2f64f7ecd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:27.696548 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-7a300d22-9da9-4da2-931e-47e2f64f7ecd admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038709 Jun 21 08:08:27.697014 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 21 08:08:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:08:29.812089 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-91330aa5-d41b-4da8-9b10-69e5cd056b44 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:29.813650 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-91330aa5-d41b-4da8-9b10-69e5cd056b44 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Jun 21 08:08:29.814309 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:29.878528 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-fb0d5ee8-6795-4035-b929-cdde46d516d6 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:29.904470 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-fb0d5ee8-6795-4035-b929-cdde46d516d6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084016 Jun 21 08:08:29.905285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 21 08:08:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:08:32.017288 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-91330aa5-d41b-4da8-9b10-69e5cd056b44 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:32.018728 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-91330aa5-d41b-4da8-9b10-69e5cd056b44 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Jun 21 08:08:32.019236 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:32.080310 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-94d40a53-60c0-4c5e-b607-8606a5b800b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "ram": 512, "swap": 0, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:32.099547 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-94d40a53-60c0-4c5e-b607-8606a5b800b0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073311 Jun 21 08:08:32.100111 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 08:08:32 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 08:08:32.114237 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-dd928c8a-b21b-4e8f-93a1-f95cb65c2a89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:32.137690 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-dd928c8a-b21b-4e8f-93a1-f95cb65c2a89 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028064 Jun 21 08:08:32.138265 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 21 08:08:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:08:34.286232 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-94d40a53-60c0-4c5e-b607-8606a5b800b0 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:34.287547 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-94d40a53-60c0-4c5e-b607-8606a5b800b0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001959 Jun 21 08:08:34.288056 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:34.361108 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-7c45d045-03d7-4a15-97e8-524cd0be454c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "id": "2"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:34.380210 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-7c45d045-03d7-4a15-97e8-524cd0be454c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086156 Jun 21 08:08:34.380819 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 08:08:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:08:34.394554 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-3ff72ab0-3655-454d-8b5d-dcc01d9535f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:34.420661 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-3ff72ab0-3655-454d-8b5d-dcc01d9535f9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031126 Jun 21 08:08:34.421459 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 21 08:08:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:08:36.704188 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-7c45d045-03d7-4a15-97e8-524cd0be454c admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:36.705333 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-7c45d045-03d7-4a15-97e8-524cd0be454c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001713 Jun 21 08:08:36.705743 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:36.773523 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-01341998-8924-4188-848e-bbb3fd2d2b7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:36.798675 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-01341998-8924-4188-848e-bbb3fd2d2b7c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085883 Jun 21 08:08:36.799565 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 08:08:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:08:36.814983 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-2a63c306-31a9-4e82-84bd-bcfc24f414de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:36.843978 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-2a63c306-31a9-4e82-84bd-bcfc24f414de admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033318 Jun 21 08:08:36.845502 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 21 08:08:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:08:39.030034 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-01341998-8924-4188-848e-bbb3fd2d2b7c admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:39.031829 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-01341998-8924-4188-848e-bbb3fd2d2b7c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Jun 21 08:08:39.032226 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:39.098009 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-0353b959-e838-48a7-9893-8b191acbfe9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "vcpus": 4}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:39.116465 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-0353b959-e838-48a7-9893-8b191acbfe9b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077878 Jun 21 08:08:39.117020 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 08:08:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 08:08:39.128960 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-5a18e032-9c02-431a-9492-2349d9936110 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:39.151763 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-5a18e032-9c02-431a-9492-2349d9936110 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026436 Jun 21 08:08:39.152370 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 21 08:08:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:08:41.241027 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-0353b959-e838-48a7-9893-8b191acbfe9b admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:08:41.242055 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-0353b959-e838-48a7-9893-8b191acbfe9b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 21 08:08:41.242609 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:08:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:08:41.319757 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-86fe0db8-7f6c-4837-bb06-684280cff9dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:41.338068 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-86fe0db8-7f6c-4837-bb06-684280cff9dc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089415 Jun 21 08:08:41.338644 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 08:08:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:08:41.351219 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-193c2fe6-da21-45f0-9456-46309276bc5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:08:41.411830 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-193c2fe6-da21-45f0-9456-46309276bc5f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063926 Jun 21 08:08:41.412771 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 21 08:08:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:09:06.112293 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-86fe0db8-7f6c-4837-bb06-684280cff9dc admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:06.113313 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-86fe0db8-7f6c-4837-bb06-684280cff9dc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 21 08:09:06.113994 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:09:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:09:06.124340 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:09:06.173467 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-f3f5c98f-fea3-4c8b-93b8-bb7e9b475b9c admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:06.190141 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-f3f5c98f-fea3-4c8b-93b8-bb7e9b475b9c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070458 Jun 21 08:09:06.190696 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 21 08:09:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:09:07.143673 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-86fe0db8-7f6c-4837-bb06-684280cff9dc admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:07.144689 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-86fe0db8-7f6c-4837-bb06-684280cff9dc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 21 08:09:07.145091 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:09:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:09:07.342047 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-64606233-ccd8-4012-86d0-44c7a4846851 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:07.348333 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.wsgi [None req-64606233-ccd8-4012-86d0-44c7a4846851 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-64606233-ccd8-4012-86d0-44c7a4846851 admin admin] Request method failure captured: Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Accept: application/json Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Accept-Encoding: gzip, deflate Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Connection: keep-alive Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Content-Length: 0 Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Host: 10.222.0.36 Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Openstack-Api-Version: compute 2.90 Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Openstack-System-Scope: None Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: User-Agent: python-novaclient Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Auth-Token: gAAAAABisXyjDVoBDU6wR0pTsL5EUaFw0F8zrbSZlnKKi9nskuKNDbN_xuE2lPE1Yfto9ZUajmypsdLtYnCya-MEzPKEyfgwt2kHQ9RJs9wqAe-Z47W915OpPyXboiuZliMX3hGj8R6S_fEz8NhOMy4DAcTdto5xWkSbkk6qxgGmc1pgv8cD4Fo Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Domain-Id: None Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Domain-Name: None Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Identity-Status: Confirmed Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Is-Admin-Project: True Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Domain-Id: default Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Domain-Name: Default Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Name: admin Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Role: reader,admin,member Jun 21 08:09:07.351653 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Roles: reader,admin,member Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e195a21c654d5fa117864a568a0c62", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Tenant: admin Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Tenant-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Tenant-Name: admin Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User: admin Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Domain-Id: default Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Domain-Name: Default Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Id: 5f407cfabb074543a5e85c709d5e3a86 Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Name: admin Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: method: > Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: exception: Flavor 42 could not be found. Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: action_args: {'id': '42'} Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:09:07.353259 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:07.354287 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:07.355452 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-64606233-ccd8-4012-86d0-44c7a4846851 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:09:07.356605 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-64606233-ccd8-4012-86d0-44c7a4846851 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066027 Jun 21 08:09:07.357842 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 21 08:09:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:07.369561 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-c73e49d2-3746-4c23-978d-2b2186708e1e admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:07.372477 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:09:07.392066 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-c73e49d2-3746-4c23-978d-2b2186708e1e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026295 Jun 21 08:09:07.392621 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 08:09:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:09:07.402640 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-138fa8d2-801d-40d4-8d06-dca6169363f7 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:07.426122 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-138fa8d2-801d-40d4-8d06-dca6169363f7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027278 Jun 21 08:09:07.426681 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 08:09:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:09:07.436284 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-942ec1a2-eb63-4ffe-8ae8-73999fe45c52 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:07.443116 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.wsgi [None req-942ec1a2-eb63-4ffe-8ae8-73999fe45c52 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-942ec1a2-eb63-4ffe-8ae8-73999fe45c52 admin admin] Request method failure captured: Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Accept: application/json Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Accept-Encoding: gzip, deflate Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Connection: keep-alive Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Content-Length: 0 Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Host: 10.222.0.36 Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Openstack-Api-Version: compute 2.90 Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Openstack-System-Scope: None Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: User-Agent: python-novaclient Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Auth-Token: gAAAAABisXyjDVoBDU6wR0pTsL5EUaFw0F8zrbSZlnKKi9nskuKNDbN_xuE2lPE1Yfto9ZUajmypsdLtYnCya-MEzPKEyfgwt2kHQ9RJs9wqAe-Z47W915OpPyXboiuZliMX3hGj8R6S_fEz8NhOMy4DAcTdto5xWkSbkk6qxgGmc1pgv8cD4Fo Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Domain-Id: None Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Domain-Name: None Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Identity-Status: Confirmed Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Is-Admin-Project: True Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Domain-Id: default Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Domain-Name: Default Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Name: admin Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Role: reader,admin,member Jun 21 08:09:07.446373 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Roles: reader,admin,member Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e195a21c654d5fa117864a568a0c62", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Tenant: admin Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Tenant-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Tenant-Name: admin Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User: admin Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Domain-Id: default Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Domain-Name: Default Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Id: 5f407cfabb074543a5e85c709d5e3a86 Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Name: admin Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: method: > Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: exception: Flavor 42 could not be found. Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: action_args: {'id': '42'} Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:09:07.447956 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:07.448875 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:07.450025 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-942ec1a2-eb63-4ffe-8ae8-73999fe45c52 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:09:07.451026 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-942ec1a2-eb63-4ffe-8ae8-73999fe45c52 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015305 Jun 21 08:09:07.451026 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 21 08:09:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 21 08:09:08.277777 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-138fa8d2-801d-40d4-8d06-dca6169363f7 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:08.278976 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-138fa8d2-801d-40d4-8d06-dca6169363f7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jun 21 08:09:08.279485 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:09:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:09:08.467723 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-4031ff5e-aed7-47d9-aeb1-e47371def62a admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:08.473631 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.wsgi [None req-4031ff5e-aed7-47d9-aeb1-e47371def62a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-4031ff5e-aed7-47d9-aeb1-e47371def62a admin admin] Request method failure captured: Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Accept: application/json Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Accept-Encoding: gzip, deflate Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Connection: keep-alive Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Content-Length: 0 Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Host: 10.222.0.36 Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Openstack-Api-Version: compute 2.90 Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Openstack-System-Scope: None Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: User-Agent: python-novaclient Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Auth-Token: gAAAAABisXykq_krLiHzl0YnnGxFwXSL6CCAQvXwb79TXnBlSpSTXl2CR9mqsj1ddXZDNUlH4RPF8lAPwDmUS9dXYqrRFKERlEAXCgm7aYsXWSUU-4gtmWlPWFLV9DpCzOivvLEi1wiBk3EEXJ0mI_uI8t_oT5lG5DoNhYv6lz8YekVEFdmH1Sg Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Domain-Id: None Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Domain-Name: None Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Identity-Status: Confirmed Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Is-Admin-Project: True Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Domain-Id: default Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Domain-Name: Default Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Name: admin Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Role: reader,admin,member Jun 21 08:09:08.475246 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Roles: reader,admin,member Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e195a21c654d5fa117864a568a0c62", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Tenant: admin Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Tenant-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Tenant-Name: admin Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User: admin Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Domain-Id: default Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Domain-Name: Default Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Id: 5f407cfabb074543a5e85c709d5e3a86 Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Name: admin Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: method: > Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: exception: Flavor 84 could not be found. Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: action_args: {'id': '84'} Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:09:08.476755 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:08.478285 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:08.480525 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-4031ff5e-aed7-47d9-aeb1-e47371def62a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:09:08.481989 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-4031ff5e-aed7-47d9-aeb1-e47371def62a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060502 Jun 21 08:09:08.481989 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 21 08:09:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:08.486797 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-cde82094-25e5-47d1-814d-dd0ff31763c3 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:08.500951 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-cde82094-25e5-47d1-814d-dd0ff31763c3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018338 Jun 21 08:09:08.501461 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 08:09:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:09:08.510648 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-e6bb110c-b3f9-4f81-a3c1-cda9279941da admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:08.525879 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-e6bb110c-b3f9-4f81-a3c1-cda9279941da admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018677 Jun 21 08:09:08.526404 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 08:09:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:09:08.535757 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-4bb75cab-a18d-4037-9e93-f909c7d53061 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:08.541215 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.wsgi [None req-4bb75cab-a18d-4037-9e93-f909c7d53061 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-4bb75cab-a18d-4037-9e93-f909c7d53061 admin admin] Request method failure captured: Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Accept: application/json Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Accept-Encoding: gzip, deflate Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Connection: keep-alive Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Content-Length: 0 Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Host: 10.222.0.36 Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Openstack-Api-Version: compute 2.90 Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Openstack-System-Scope: None Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: User-Agent: python-novaclient Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Auth-Token: gAAAAABisXykq_krLiHzl0YnnGxFwXSL6CCAQvXwb79TXnBlSpSTXl2CR9mqsj1ddXZDNUlH4RPF8lAPwDmUS9dXYqrRFKERlEAXCgm7aYsXWSUU-4gtmWlPWFLV9DpCzOivvLEi1wiBk3EEXJ0mI_uI8t_oT5lG5DoNhYv6lz8YekVEFdmH1Sg Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Domain-Id: None Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Domain-Name: None Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Identity-Status: Confirmed Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Is-Admin-Project: True Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Domain-Id: default Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Domain-Name: Default Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Name: admin Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Role: reader,admin,member Jun 21 08:09:08.542885 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Roles: reader,admin,member Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e195a21c654d5fa117864a568a0c62", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Tenant: admin Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Tenant-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Tenant-Name: admin Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User: admin Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Domain-Id: default Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Domain-Name: Default Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Id: 5f407cfabb074543a5e85c709d5e3a86 Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Name: admin Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: method: > Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: exception: Flavor 84 could not be found. Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: action_args: {'id': '84'} Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:09:08.544369 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:08.545366 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:08.547367 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-4bb75cab-a18d-4037-9e93-f909c7d53061 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:09:08.548667 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-4bb75cab-a18d-4037-9e93-f909c7d53061 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012117 Jun 21 08:09:08.548667 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 21 08:09:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:09.368559 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-e6bb110c-b3f9-4f81-a3c1-cda9279941da admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:09.369565 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-e6bb110c-b3f9-4f81-a3c1-cda9279941da admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 21 08:09:09.369961 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:09:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:09:09.562454 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-0da842d4-d4a6-4007-947d-bcec744334c1 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:09.568380 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.wsgi [None req-0da842d4-d4a6-4007-947d-bcec744334c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-0da842d4-d4a6-4007-947d-bcec744334c1 admin admin] Request method failure captured: Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Accept: application/json Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Accept-Encoding: gzip, deflate Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Connection: keep-alive Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Content-Length: 0 Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Host: 10.222.0.36 Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Openstack-Api-Version: compute 2.90 Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Openstack-System-Scope: None Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: User-Agent: python-novaclient Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Auth-Token: gAAAAABisXylqKnUXnGVuVo1Jzf9fos02j66u8lwt-HL_JhAjubQkMZb6Lu9jk_bvPjl7LYMP_rhv7NLoObtPktWihZqpSsvuNQCtaDRnMDXxvDdf7rCx7OoUDhQ4QaQjYueqyW5jlC6fTkgbIgjCjI-BgiWPZnfaQE4MxybgQ6jt1qiSXjJWYE Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Domain-Id: None Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Domain-Name: None Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Identity-Status: Confirmed Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Is-Admin-Project: True Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Domain-Id: default Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Domain-Name: Default Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Project-Name: admin Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Role: reader,admin,member Jun 21 08:09:09.569934 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Roles: reader,admin,member Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e195a21c654d5fa117864a568a0c62", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Tenant: admin Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Tenant-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-Tenant-Name: admin Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User: admin Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Domain-Id: default Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Domain-Name: Default Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Id: 5f407cfabb074543a5e85c709d5e3a86 Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: X-User-Name: admin Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: method: > Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: exception: Flavor 451 could not be found. Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: action_args: {'id': '451'} Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:09:09.571258 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:09.572989 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 21 08:09:09.574043 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-0da842d4-d4a6-4007-947d-bcec744334c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:09:09.575064 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-0da842d4-d4a6-4007-947d-bcec744334c1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063078 Jun 21 08:09:09.575064 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 08:09:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:09.581602 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-d8587f22-332f-445d-acf0-1bb2706b6fbc admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:09.594972 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-d8587f22-332f-445d-acf0-1bb2706b6fbc admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017561 Jun 21 08:09:09.595492 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 08:09:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:09:09.604790 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:09.618797 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017549 Jun 21 08:09:09.619331 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 08:09:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:09:09.629166 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-8ba19192-4e7b-4058-8140-516cab91cec2 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:09.634402 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.wsgi [None req-8ba19192-4e7b-4058-8140-516cab91cec2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-8ba19192-4e7b-4058-8140-516cab91cec2 admin admin] Request method failure captured: Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Accept: application/json Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Accept-Encoding: gzip, deflate Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Connection: keep-alive Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Content-Length: 0 Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Host: 10.222.0.36 Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Openstack-Api-Version: compute 2.90 Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Openstack-System-Scope: None Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: User-Agent: python-novaclient Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Auth-Token: gAAAAABisXylqKnUXnGVuVo1Jzf9fos02j66u8lwt-HL_JhAjubQkMZb6Lu9jk_bvPjl7LYMP_rhv7NLoObtPktWihZqpSsvuNQCtaDRnMDXxvDdf7rCx7OoUDhQ4QaQjYueqyW5jlC6fTkgbIgjCjI-BgiWPZnfaQE4MxybgQ6jt1qiSXjJWYE Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Domain-Id: None Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Domain-Name: None Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Identity-Status: Confirmed Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Is-Admin-Project: True Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Domain-Id: default Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Domain-Name: Default Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Project-Name: admin Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Role: reader,admin,member Jun 21 08:09:09.635926 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Roles: reader,admin,member Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e195a21c654d5fa117864a568a0c62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e195a21c654d5fa117864a568a0c62", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Tenant: admin Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Tenant-Id: 48e195a21c654d5fa117864a568a0c62 Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-Tenant-Name: admin Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User: admin Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Domain-Id: default Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Domain-Name: Default Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Id: 5f407cfabb074543a5e85c709d5e3a86 Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: X-User-Name: admin Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: method: > Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: exception: Flavor 451 could not be found. Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: action_args: {'id': '451'} Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:09:09.637401 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:09.638336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 21 08:09:09.639739 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-8ba19192-4e7b-4058-8140-516cab91cec2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:09:09.641688 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-8ba19192-4e7b-4058-8140-516cab91cec2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011626 Jun 21 08:09:09.641688 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 08:09:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:10.480615 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:10.481625 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 21 08:09:10.482020 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:09:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:09:10.676253 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-a9aa195b-bb59-495e-957d-f996d4fd367b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:09:10.694175 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-a9aa195b-bb59-495e-957d-f996d4fd367b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072244 Jun 21 08:09:10.694695 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 21 08:09:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:09:11.524028 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:11.525040 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 21 08:09:11.525434 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:09:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:09:11.716064 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-cb908bbc-252c-47dd-81c9-8ace45b98d87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:09:11.732646 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-cb908bbc-252c-47dd-81c9-8ace45b98d87 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070051 Jun 21 08:09:11.733130 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 21 08:09:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:09:12.575324 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:12.576341 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 21 08:09:12.576745 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:09:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:09:12.769330 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-1848747f-a2bd-4942-a46c-aa0b21ccb665 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:09:12.786847 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-1848747f-a2bd-4942-a46c-aa0b21ccb665 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072308 Jun 21 08:09:12.787320 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 21 08:09:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:09:13.604172 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:13.605168 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 21 08:09:13.605563 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:09:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:09:13.800845 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-8e48bb5d-f86e-4d95-b3a3-94f2c3420d6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:09:13.818325 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-8e48bb5d-f86e-4d95-b3a3-94f2c3420d6d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071120 Jun 21 08:09:13.818829 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 21 08:09:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:09:14.644439 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:14.645438 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 21 08:09:14.645983 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:09:14.838876 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-6c9b9cb8-f956-4ad6-acf1-333a3c151c89 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:09:14.858021 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-6c9b9cb8-f956-4ad6-acf1-333a3c151c89 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074303 Jun 21 08:09:14.858549 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Jun 21 08:09:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:10:02.053329 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:10:02.054345 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-586e0cf5-afa1-47a5-8b7e-c4649145ab69 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 21 08:10:02.054796 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 08:10:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:10:02.064947 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:10:02.113329 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-cba22ba1-296e-4129-8bbf-3def121cf4f5 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:10:02.132116 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-cba22ba1-296e-4129-8bbf-3def121cf4f5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071678 Jun 21 08:10:02.132645 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 21 08:10:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:10:02.155245 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-c75e2209-8e6c-47d5-aee2-b097829bcc13 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:10:02.159364 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=14 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:10:02.164910 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-c75e2209-8e6c-47d5-aee2-b097829bcc13 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013211 Jun 21 08:10:02.165431 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1282 bytes} [Tue Jun 21 08:10:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:10:02.177186 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-3470fc86-ae30-4a59-af50-da1b99d35b2f admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:10:02.184581 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-3470fc86-ae30-4a59-af50-da1b99d35b2f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010961 Jun 21 08:10:02.185077 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1285 bytes} [Tue Jun 21 08:10:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:10:02.196195 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-8f87afb7-80a4-4236-a09d-7272eb1ae2ae admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:10:02.203742 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-8f87afb7-80a4-4236-a09d-7272eb1ae2ae admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011204 Jun 21 08:10:02.204267 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1285 bytes} [Tue Jun 21 08:10:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:10:02.215307 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-44ddd47a-2719-43f4-9405-435c909de998 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:10:02.223221 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-44ddd47a-2719-43f4-9405-435c909de998 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011370 Jun 21 08:10:02.223731 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1282 bytes} [Tue Jun 21 08:10:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:13:14.242592 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-8f87afb7-80a4-4236-a09d-7272eb1ae2ae admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:13:14.243625 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-8f87afb7-80a4-4236-a09d-7272eb1ae2ae admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 21 08:13:14.244015 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:13:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:13:14.384383 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_api:SELECT=6 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:13:14.498408 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-8f116fab-523f-465c-95fc-2a70db155ee7 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:13:14.499575 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:13:14.499575 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: warnings.warn(msg) Jun 21 08:13:14.500759 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-8f116fab-523f-465c-95fc-2a70db155ee7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:13:14.501197 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-8f116fab-523f-465c-95fc-2a70db155ee7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:13:14.501973 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-8f116fab-523f-465c-95fc-2a70db155ee7 admin admin] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:13:14.502397 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-8f116fab-523f-465c-95fc-2a70db155ee7 admin admin] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:13:14.535951 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-8f116fab-523f-465c-95fc-2a70db155ee7 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153003 Jun 21 08:13:14.536495 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 08:13:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:13:15.378183 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-8f87afb7-80a4-4236-a09d-7272eb1ae2ae admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:13:15.379214 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-8f87afb7-80a4-4236-a09d-7272eb1ae2ae admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 21 08:13:15.379605 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:13:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:13:15.580988 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-9d60b497-9504-448a-bcfc-bd35aa6a784a admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:13:15.582150 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:13:15.582150 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: warnings.warn(msg) Jun 21 08:13:15.583408 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-9d60b497-9504-448a-bcfc-bd35aa6a784a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:13:15.583868 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-9d60b497-9504-448a-bcfc-bd35aa6a784a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:13:15.584687 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-9d60b497-9504-448a-bcfc-bd35aa6a784a admin admin] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:13:15.585119 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-9d60b497-9504-448a-bcfc-bd35aa6a784a admin admin] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:13:15.605728 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-9d60b497-9504-448a-bcfc-bd35aa6a784a admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081697 Jun 21 08:13:15.606200 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 08:13:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 08:13:26.853244 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-8f87afb7-80a4-4236-a09d-7272eb1ae2ae admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:13:26.854279 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-8f87afb7-80a4-4236-a09d-7272eb1ae2ae admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 21 08:13:26.854698 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:13:27.002899 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_cell0:SELECT=4 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:13:27.003617 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_cell1:SELECT=4 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:13:27.004225 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_api:SELECT=8 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:13:27.053714 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-5274a953-e9a3-4ca7-8a9a-d56738fcbf00 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:13:27.054909 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:13:27.054909 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: warnings.warn(msg) Jun 21 08:13:27.056087 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-5274a953-e9a3-4ca7-8a9a-d56738fcbf00 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:13:27.056529 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-5274a953-e9a3-4ca7-8a9a-d56738fcbf00 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:13:27.057343 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-5274a953-e9a3-4ca7-8a9a-d56738fcbf00 admin admin] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:13:27.057801 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-5274a953-e9a3-4ca7-8a9a-d56738fcbf00 admin admin] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:13:27.083336 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-5274a953-e9a3-4ca7-8a9a-d56738fcbf00 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085558 Jun 21 08:13:27.083882 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 08:13:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:13:27.940748 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-8f87afb7-80a4-4236-a09d-7272eb1ae2ae admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:13:27.942955 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-8f87afb7-80a4-4236-a09d-7272eb1ae2ae admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002609 Jun 21 08:13:27.943359 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 08:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:13:28.150386 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-731f06c8-8495-4421-a99b-f4009b2ded0e admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:13:28.151517 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:13:28.151517 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: warnings.warn(msg) Jun 21 08:13:28.152719 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-731f06c8-8495-4421-a99b-f4009b2ded0e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:13:28.153434 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-731f06c8-8495-4421-a99b-f4009b2ded0e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:13:28.154241 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-731f06c8-8495-4421-a99b-f4009b2ded0e admin admin] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:13:28.154713 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-731f06c8-8495-4421-a99b-f4009b2ded0e admin admin] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:13:28.176793 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-731f06c8-8495-4421-a99b-f4009b2ded0e admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078331 Jun 21 08:13:28.177337 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 08:13:28 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:14:24.326135 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: Tue Jun 21 08:14:24 2022 - graceful shutdown triggered... Jun 21 08:14:24.326687 dv-cinder-836973-7-iscsi devstack@n-api.service[103198]: Gracefully killing worker 1 (pid: 103198)... Jun 21 08:14:24.326261 dv-cinder-836973-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 21 08:14:24.327506 dv-cinder-836973-7-iscsi devstack@n-api.service[103199]: Gracefully killing worker 2 (pid: 103199)... Jun 21 08:14:25.326745 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: worker 1 buried after 1 seconds Jun 21 08:14:25.327295 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: worker 2 buried after 1 seconds Jun 21 08:14:25.327295 dv-cinder-836973-7-iscsi devstack@n-api.service[103197]: goodbye to uWSGI. Jun 21 08:14:25.328277 dv-cinder-836973-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 21 08:14:25.328824 dv-cinder-836973-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 21 08:14:25.331695 dv-cinder-836973-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 08:14:25.340912 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 08:14:25.343637 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 08:14:25 2022] *** Jun 21 08:14:25.343801 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 08:14:25.343948 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 08:14:25.344062 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: nodename: dv-cinder-836973-7-iscsi Jun 21 08:14:25.344172 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: machine: x86_64 Jun 21 08:14:25.344290 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: clock source: unix Jun 21 08:14:25.344406 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: pcre jit disabled Jun 21 08:14:25.344516 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: detected number of CPU cores: 4 Jun 21 08:14:25.344625 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: current working directory: / Jun 21 08:14:25.344735 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: detected binary path: /usr/bin/uwsgi-core Jun 21 08:14:25.344850 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: your processes number limit is 47680 Jun 21 08:14:25.344972 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: your memory page size is 4096 bytes Jun 21 08:14:25.345091 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: detected max file descriptor number: 2048 Jun 21 08:14:25.345203 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: lock engine: pthread robust mutexes Jun 21 08:14:25.345482 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: thunder lock: enabled Jun 21 08:14:25.345802 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 08:14:25.345929 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 08:14:25.391911 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: Python main interpreter initialized at 0x5586424a69c0 Jun 21 08:14:25.391911 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: python threads support enabled Jun 21 08:14:25.391911 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: your server socket listen backlog is limited to 100 connections Jun 21 08:14:25.391911 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: your mercy for graceful operations on workers is 90 seconds Jun 21 08:14:25.392328 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 08:14:25.392426 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: *** Operational MODE: preforking *** Jun 21 08:14:25.392648 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: *** uWSGI is running in multiple interpreter mode *** Jun 21 08:14:25.392648 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: spawned uWSGI master process (pid: 117530) Jun 21 08:14:25.392848 dv-cinder-836973-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 08:14:25.393569 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: spawned uWSGI worker 1 (pid: 117547, cores: 1) Jun 21 08:14:25.402935 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: spawned uWSGI worker 2 (pid: 117548, cores: 1) Jun 21 08:14:25.403361 dv-cinder-836973-7-iscsi devstack@n-api.service[117530]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 08:14:26.053083 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 08:14:26.068693 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 08:14:27.275833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:14:27.275833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: from cryptography.utils import int_from_bytes Jun 21 08:14:27.276487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:14:27.276487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: from cryptography.utils import int_from_bytes Jun 21 08:14:27.277749 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:14:27.277749 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: from cryptography.utils import int_from_bytes Jun 21 08:14:27.278175 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:14:27.278175 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: from cryptography.utils import int_from_bytes Jun 21 08:14:29.688524 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 08:14:29.689172 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 08:14:29.689440 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 08:14:29.689700 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 08:14:29.689982 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 08:14:29.690375 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.690727 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.691091 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.691414 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.691751 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.692154 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.692465 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.692898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.693241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.693511 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.693833 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.694162 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-7-iscsi {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.694492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.694831 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.695149 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.695471 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.695780 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.696106 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.696261 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 08:14:29.696655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.696739 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 08:14:29.696908 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.697065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 08:14:29.697351 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.697467 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 08:14:29.697664 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.697776 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 08:14:29.697986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.698326 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.698430 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.698672 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.698793 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.698999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.699112 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.699309 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.699419 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.699626 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.699755 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.699955 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.700075 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.700262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.700361 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.700610 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.700721 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-7-iscsi {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.700951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.701057 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.701218 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.701319 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.701544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.701639 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.701880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-7-iscsi {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.701984 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.702212 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.702319 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.702526 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.702651 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.702892 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.702996 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.703220 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.703321 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.703534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.703645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.703866 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.703972 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.704178 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.704284 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.704511 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.704693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.704953 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.705056 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.705154 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.705310 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.705414 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.705626 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.705727 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.705971 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.706149 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.706299 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.706401 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.707129 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.707243 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.707402 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.707513 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.707715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.707816 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.708042 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.708264 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.708381 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.708489 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.708695 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.708803 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-7-iscsi {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.708957 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.709125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710134 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710208 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710279 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710358 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710358 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710510 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710597 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710826 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.710908 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.711178 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.711276 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.711357 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.711438 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.711675 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.711791 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.711985 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.712093 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.712295 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.712407 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.712618 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.712733 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.712945 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.713044 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.714333 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.714453 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.714538 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.714715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.714820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.714902 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.714902 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.715141 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.715383 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.715514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.715626 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.715789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.715935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.716077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.716077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.716357 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.716497 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.716677 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.716866 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.717010 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.717164 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.717306 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.717456 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.717613 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.717613 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.717908 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.718059 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.718207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.718355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.718505 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.718727 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.718901 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.719051 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.719201 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.719201 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.719487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.719629 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.719778 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.719925 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.720073 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.720292 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.720440 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.720589 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.720750 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.720903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.721044 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.721194 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.721340 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.721497 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.721650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.721798 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.721945 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.722133 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.722909 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723051 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723158 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723247 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723332 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723507 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723605 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723690 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723780 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723870 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.723960 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.724051 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.724146 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.724326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.724485 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.724654 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.724802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.724958 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.725114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.725277 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.725427 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.725568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.725709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.725861 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.726009 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.726201 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.726369 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.726545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.726719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.726887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.727036 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.727176 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.727339 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.727482 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.727623 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.727771 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.727911 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.728061 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.728223 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.728373 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.728514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.728661 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.728812 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.728959 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.729112 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.729273 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.729413 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.729554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.729695 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.729843 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.729992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.730142 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.730301 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.730517 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.730696 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.730861 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.731003 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.731150 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.731310 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.731458 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.731609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.731759 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.731901 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.732041 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.732181 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.732327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.732475 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.732628 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.732781 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.732947 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.733175 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.733329 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.733476 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.733705 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.733861 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.734004 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.734153 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.734153 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.734440 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.734588 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.734828 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.734971 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.735187 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.735348 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.735507 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.735655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.735796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.735950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.736091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.736238 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.736387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.736527 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.736713 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.736870 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.737013 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.737161 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.737326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.737515 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.737658 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.737840 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.737993 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.738142 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.738290 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.738437 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.738587 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.738813 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.738957 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.739109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.739267 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.739416 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.739564 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.739706 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.739853 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.740000 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.740150 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.740291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.740443 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.740681 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.740829 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.740977 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.741126 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.741284 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.741444 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.741593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.741734 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.741874 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.742023 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.742177 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.742325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.742472 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.742630 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.742781 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.742932 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:14:29.743086 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.743334 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.743483 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.743634 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.743870 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.744019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.744161 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.744311 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.744453 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.744601 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.744741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.744890 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.745031 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.745194 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.745344 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.745490 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.745631 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.745785 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.745940 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.746090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.746238 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.746380 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.746528 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.746936 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.747095 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.747245 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.747397 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.747538 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.747686 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.747827 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.747976 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.748123 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.748264 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.748412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.748585 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.748735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.748912 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.749061 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.749236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.749403 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.749553 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.749702 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.749852 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.749993 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.750179 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.750328 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.750477 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.750752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.750921 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.751064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.751222 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.751375 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.751527 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.751678 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.751830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.751979 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.752120 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.752260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.752400 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.752554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.752703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.752852 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.753001 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.753149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.753324 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.753574 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.753730 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.753896 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.754113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.754259 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.754401 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.754551 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.754714 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.754858 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.755009 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.755151 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.755301 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.755461 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.755610 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.755752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.755901 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.756042 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.756197 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.756353 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.756502 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.756644 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.756792 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.756935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.757084 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.757225 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.757386 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.757528 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.757675 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.757824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.757978 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.758126 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.758267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.758414 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.758555 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.758747 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.758897 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.759047 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.759196 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.759347 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.759495 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.759644 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.759814 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.759963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.760137 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.760291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.760440 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.760595 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.760758 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.760983 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.761139 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.761308 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.761458 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.761674 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.761818 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.761966 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.762108 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.762256 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.762406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.762555 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.762736 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.762887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.763037 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.763180 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.763347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.763489 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.763716 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.763864 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.764014 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.764236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.764397 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.764548 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.764695 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.764837 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.764978 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.765125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.765276 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.765434 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.765576 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.765716 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.765862 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.766012 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.766154 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.766304 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.766451 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.766593 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.766810 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.766978 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.767126 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.767274 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.767440 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.767594 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.767749 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.767910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.768059 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.768206 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.768354 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.768509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.768664 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.768824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.769473 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.769638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.769797 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.769952 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.770165 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.770339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.770498 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.770665 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.770832 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.770999 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.771235 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.771389 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.771545 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.771703 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.771859 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.772018 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.772175 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.772324 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.772324 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.772621 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.772770 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.772917 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.773074 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.773229 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.773377 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.773525 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.773698 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.773937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.773937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.774254 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.774470 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.774470 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.774968 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.775136 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.775287 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.775443 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.775599 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.775755 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.775909 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.776071 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.776235 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.776401 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.776559 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.776706 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.776864 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.777030 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.777178 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.777325 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.777472 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.777627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.777788 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.777944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.778093 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.778239 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.778404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.778567 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.778755 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.778906 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.779053 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.779208 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.779371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.779526 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.779686 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.779842 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.779998 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.780152 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.780365 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.780515 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.780676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.780832 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.780988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.781148 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.781388 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.781547 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.781709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.781865 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.782014 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.782169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.782324 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.782497 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.782497 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.782839 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.782989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.783137 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.783291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.783452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.783601 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.783755 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.783921 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.784143 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.784298 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.784477 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.785295 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.785525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.785681 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.785830 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.785978 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.786135 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.786292 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.786448 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.786611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.786793 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.786959 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.787109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.787267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.787438 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.787594 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.787749 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.787910 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.788077 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.788226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.788381 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.788535 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.788682 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.788839 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.788986 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.789133 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.789295 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.789454 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.789609 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.789873 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.790044 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.790205 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.790362 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.790518 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.790712 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.790876 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.791032 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.791182 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.792035 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.792208 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.792359 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.792516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.792516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.792516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.792516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.792516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.792516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.792516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.793575 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.793575 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.793575 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.794015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.794015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.794414 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.794777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.795053 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.795374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.795675 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.795835 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.795998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.796192 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.796348 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.796548 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.796703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.796905 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.797160 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.797316 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.797501 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.797663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.797812 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.797968 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.798135 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.798284 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.798441 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.798598 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.798870 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.799041 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.799189 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.799346 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.799495 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.799650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.799798 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.799961 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.800122 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.800876 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.801035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.801239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.801399 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.801547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.801701 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.801867 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.802045 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.802270 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.802431 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.802589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.802760 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.802931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.803131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.803415 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.803570 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.803725 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.803872 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.804020 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.804181 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.804336 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.804593 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.804762 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.804912 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.805153 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.805326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.805476 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.805632 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.805787 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.805944 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.806105 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.806255 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.806403 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.806558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.806775 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.807083 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.807083 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.807378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.807378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.807660 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.807660 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.807956 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.808112 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.808261 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.808415 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.808563 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.808724 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.808873 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.809021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.809167 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.809325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.809480 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.809648 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.809806 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.809955 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.810109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.810264 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.810453 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.810453 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.810794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.810946 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.811093 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.811258 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.811408 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.811564 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.811719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.811877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.812033 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.812189 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.812431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.812647 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.812807 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.812964 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.813113 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.813261 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.813429 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.813578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.813578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.813867 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.814031 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.814180 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.814336 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.814484 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.814760 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.814917 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.815072 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.815318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.815488 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.815488 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.815791 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.816491 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.816656 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.816821 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.816970 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.817117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.817272 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.817421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.817622 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.817781 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.817931 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.818086 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.818246 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.818407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.818555 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.818741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.818898 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.819047 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.819217 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.819367 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.819515 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.819663 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.819818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.819973 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.820149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.820305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.820453 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.820607 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.820755 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.820913 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.820913 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.821217 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.821365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.821515 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.821669 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.821823 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.821984 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.822143 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.822298 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.822529 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.822721 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.822907 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.823069 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.823226 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.823373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.823529 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.823684 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.823840 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.823990 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.824146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.824312 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.824461 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.824608 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.824852 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.825081 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.825243 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.825480 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.825651 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.825803 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.825803 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.826100 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.826256 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.826411 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.826581 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.826773 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.826931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.827089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.827238 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.827386 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.827541 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.827703 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.827860 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.828009 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.828158 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.828305 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.828463 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.828620 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.828776 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.828939 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.829088 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.829244 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.829393 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.829549 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.829698 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.829845 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.830001 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.830156 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.830314 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.830473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.830674 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.830829 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.830988 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.831144 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.831302 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.831471 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.831635 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.831800 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.831954 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.832147 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.832375 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.832553 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.832788 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.832950 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.833101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.833266 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.833425 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.833582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.833582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.833878 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.834034 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.834199 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.834356 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.834504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.834669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.834844 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.834994 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.835244 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.835407 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.835641 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.835804 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.835953 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.836109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.836275 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.836424 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.836572 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.836721 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.836875 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.837034 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.837191 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.837350 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.837499 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.837648 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.837804 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.837963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.838121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.838277 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.838434 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.838590 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.838782 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.838954 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.839104 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.839252 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.839406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.839561 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.839718 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.839880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.840029 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.840177 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.840324 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.840324 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.840613 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.840771 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.840948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.840948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.841239 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.841239 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.841544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.841544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.841835 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.841988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.842143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.842292 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.842454 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.842609 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.842799 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.843045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.843206 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.843355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.843511 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.843677 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.843840 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.843989 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.844137 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.844292 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.844449 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.844598 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.844753 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.844902 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.845067 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.845241 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.845465 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.845636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.845861 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.846015 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.846164 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.846326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.846485 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.846669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.846825 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.846975 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.847198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.847428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.847590 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.847749 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.847906 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.848072 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.848227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.848390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.848539 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.848686 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.848841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.848997 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.849146 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.849319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.849468 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.849625 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.849782 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.849939 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.850095 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.850252 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.850417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.850582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.850768 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.850927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.851085 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.851241 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.851408 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.851570 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.851726 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.851891 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.852054 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.852204 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.852360 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.852508 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.852663 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.852812 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.852973 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.853216 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.853373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.853535 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.853690 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.853860 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.854017 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.854173 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.854321 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.854470 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.854634 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.854805 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.854955 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.855111 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.855259 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.855418 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.855673 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.855852 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.856074 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.856235 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.856235 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.856534 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.856683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.856839 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.856988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.857150 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.857312 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.857467 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.857640 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.857789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.857936 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.858090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.858245 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.858393 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.858554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.858727 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.858887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.859042 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.859042 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.859324 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.859484 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.859644 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.859799 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.859953 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.860101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.860261 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.860416 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.860564 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.860719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.860866 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.861023 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.861186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.861343 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.861491 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.861650 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.861815 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.861984 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.862140 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.862296 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.862453 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.862600 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.863404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.863562 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.863711 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.863868 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.864024 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.864184 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.864346 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.864495 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.864643 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.864798 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.864961 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.865110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.865267 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.865423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.865587 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.868101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.868101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.868435 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.868618 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.868771 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.868921 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.869070 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.869219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.869377 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.869535 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.869685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.869834 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.869981 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.870131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.870289 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.870438 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.870438 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.870438 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.870914 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.871080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.871250 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.871406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.871406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.871973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.872123 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.872123 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.872435 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.872585 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.872585 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.872878 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.873026 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.873182 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.873339 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.873590 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.873752 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.873903 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.874050 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.874212 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.874370 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.874526 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.874765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.875044 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.875207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.875207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.875512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.875661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.875826 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.876061 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.876215 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.876526 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.876697 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.876858 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.877015 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.877172 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.877345 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.877503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.877652 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.877800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.877949 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.878152 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.878326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.878550 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.878747 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.878907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.879064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.879213 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.879213 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.879531 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.879680 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.879827 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.879975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.880123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.880284 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.880433 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.880589 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.880738 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.880738 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.881037 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.881037 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.881329 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.881477 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.881634 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.881790 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.881951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.882100 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.882248 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.882406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.882554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.882554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.882554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.882554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.882554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.883368 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.883525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.883759 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.883925 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.884075 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.884231 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.884387 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.884544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.884706 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.884856 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.885004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.885161 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.885310 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.885469 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.885631 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.885788 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.885937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.886172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.886334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.886509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.886759 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.886917 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.887066 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.887215 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.887371 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.887580 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.887737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.887895 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.888053 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.888053 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.888352 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.888511 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.888660 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.888808 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.888966 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.889122 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.889278 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.889435 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.889604 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.889753 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.889968 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.890142 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.890308 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.890458 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.890605 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.890833 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.890983 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.891139 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.891297 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.891446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.891603 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.891758 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.891907 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.892062 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.892219 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.892377 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.892533 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.892682 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.892838 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.892999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.893150 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.893150 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.893150 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.893583 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.893750 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.894006 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.894171 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.894329 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.894485 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.894703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.894703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.895094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.895094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.895094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.895521 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.895681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.895828 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.895985 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.896148 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.896387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.896387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.896699 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.896952 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.897107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.897264 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.897415 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.897571 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.897734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.897897 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.898046 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.898202 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.898356 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.898506 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.898681 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.898848 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.898999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.899147 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.899294 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.899443 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.899599 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.899767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.899924 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.900073 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.900229 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.900384 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.900542 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.900698 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.900847 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.900995 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.901142 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.901290 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.901447 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.901447 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.901740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.901888 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.902046 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.902046 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.902424 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.902584 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.902770 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.902928 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.903082 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.903237 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.903394 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.903543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.903700 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.903866 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.904108 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.904272 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.904429 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.904577 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.904726 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.904889 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.905045 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.905207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.905363 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.905513 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.905661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.905820 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.905976 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.906137 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.906293 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.906528 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.906710 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.906863 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.907101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.907264 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.907427 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.907587 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.907743 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.907910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.908077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.908077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.908360 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.908360 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.908642 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.908642 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.908945 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.909094 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.909258 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.909406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.909554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.910323 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.910477 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.910644 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.910800 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.910949 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.911099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.911258 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.911408 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.911555 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.911711 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.911860 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.912008 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.912169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.912336 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.912485 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.912633 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.912787 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.912949 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.913099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.913262 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.913411 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.913560 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.913560 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.913862 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.914018 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.914254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.914428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.914577 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.914577 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.914921 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.914921 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.915221 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.915221 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.915503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.915650 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.915807 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.915963 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.916119 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.916285 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.916440 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.916690 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.916847 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.916996 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.917234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.917398 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.917556 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.917556 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.917857 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.918006 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.918155 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.918304 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.918461 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.918642 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.918808 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.918964 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.919119 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.919268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.919415 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.919571 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.919719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.919867 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.919867 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.920155 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.920155 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.920470 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.920619 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.920775 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.920923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.921078 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.921234 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.921383 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.921531 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.921679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.921825 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.921980 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.922141 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.922300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.922448 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.922597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.922780 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.922947 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.923097 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.923245 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.923399 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.923399 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.923699 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.923860 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.924016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.924172 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.924436 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.924436 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.924728 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.924885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.925035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.925035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.925379 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.925530 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.925687 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.925960 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.926129 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.926280 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.926447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.926606 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.926910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.927062 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.927228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.927448 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.927610 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.927767 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.927931 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.928080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.928228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.928383 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.928534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.928701 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.928860 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.929008 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.929165 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.929327 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.929476 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.929632 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.929788 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.929983 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.930137 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.930293 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.930443 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.930599 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.930781 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.930941 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.931097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.931253 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.931404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.931404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.931404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.931404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.931404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.931404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.931404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.931404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.932600 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.932600 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.932600 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.933042 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.933042 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.933522 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.933869 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.934199 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.934547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.934915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.935234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.935550 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.935867 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.936201 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.936524 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.936907 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.937162 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.937487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.937801 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.938127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.938445 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.938803 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.939127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.939560 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.939732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.939897 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.940083 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.940250 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.940408 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.940557 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.940706 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.941367 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.941570 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.941891 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.942220 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.942382 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.942540 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.942725 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.942889 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.943053 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.943210 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.943359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.943509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.943663 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.944390 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.944390 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.945380 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.945549 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.945704 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.945870 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.946027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.946184 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.946347 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.946499 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.946748 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.946951 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.947253 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.947458 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.947716 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.947883 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.948040 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.948209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.948366 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.948516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.948679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.948837 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.948994 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.949157 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.949314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.949463 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.949621 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.949781 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.949970 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.950207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.950467 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.950749 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.951002 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.951234 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.951466 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.951714 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.951714 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.952200 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.952444 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.952683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.952683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.953136 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.953403 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.953890 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.954150 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.954394 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.954708 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.955084 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.955346 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.955601 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.955841 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.956078 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.956336 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.957127 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.957776 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.958192 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.958435 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.958711 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.958948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.959162 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.959383 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.959591 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.959798 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.959996 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.960215 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.960215 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.960561 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.960749 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.960864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961019 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961159 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961263 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961545 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961637 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961722 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961816 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961816 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.961816 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962039 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962791 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.962887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963050 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963142 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963414 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963505 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963589 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963680 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963771 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963771 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.963954 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.964046 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.964136 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.964227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.964227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.964394 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.964487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.964487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.964654 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.964745 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.964882 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.965016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.965210 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.965477 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.965591 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.965851 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.966058 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.966189 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.966527 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.966643 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.966878 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.967214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.967321 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.967559 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.967829 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.968005 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.968231 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.968405 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.968783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.969004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.969160 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.969309 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.969585 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.969740 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.969891 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.969985 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.970061 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.970133 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 08:14:29.970322 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.971650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.971987 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.972448 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.972785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.973121 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.973642 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.974251 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.974881 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.975507 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.976118 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.976685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.977044 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.977378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.977727 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.978074 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.978452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.978889 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.979188 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.979534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.979862 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.980191 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.980514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:14:29.980767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 08:14:30.035341 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO dbcounter [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Registered counter for database nova_api Jun 21 08:14:30.043947 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO dbcounter [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Registered counter for database nova_api Jun 21 08:14:30.055983 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_db.sqlalchemy.engines [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:14:30.063167 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writer thread running {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:14:30.064038 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_db.sqlalchemy.engines [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:14:30.071131 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writer thread running {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:14:30.122591 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.context [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad5ffcf-142b-4048-bb9c-97a48bfdc94c(cell1) {{(pid=117548) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 08:14:30.126744 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:14:30.127163 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.context [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad5ffcf-142b-4048-bb9c-97a48bfdc94c(cell1) {{(pid=117547) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 08:14:30.128879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:14:30.130286 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:14:30.131839 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:14:30.132281 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:14:30.133448 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:14:30.134265 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:14:30.134374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO dbcounter [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Registered counter for database nova_cell0 Jun 21 08:14:30.136249 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:14:30.138249 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO dbcounter [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Registered counter for database nova_cell0 Jun 21 08:14:30.138409 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO dbcounter [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Registered counter for database nova_cell1 Jun 21 08:14:30.142525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO dbcounter [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Registered counter for database nova_cell1 Jun 21 08:14:30.146430 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_db.sqlalchemy.engines [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:14:30.148950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_db.sqlalchemy.engines [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:14:30.149998 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_db.sqlalchemy.engines [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:14:30.151325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_db.sqlalchemy.engines [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:14:30.153655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writer thread running {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:14:30.154991 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writer thread running {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:14:30.157302 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writer thread running {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:14:30.160612 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writer thread running {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:14:30.309736 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO dbcounter [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Registered counter for database nova_cell0 Jun 21 08:14:30.318598 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_db.sqlalchemy.engines [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:14:30.319754 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO dbcounter [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Registered counter for database nova_cell0 Jun 21 08:14:30.326214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writer thread running {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:14:30.326975 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_db.sqlalchemy.engines [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:14:30.332392 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writer thread running {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:14:30.667806 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: WARNING keystonemiddleware.auth_token [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 08:14:30.675292 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: WARNING keystonemiddleware.auth_token [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 08:14:30.678935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: WARNING keystonemiddleware.auth_token [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 08:14:30.686479 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: WARNING keystonemiddleware.auth_token [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 08:14:31.042835 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: WARNING keystonemiddleware.auth_token [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 08:14:31.043460 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: WARNING keystonemiddleware.auth_token [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 08:14:31.048893 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: WARNING keystonemiddleware.auth_token [None req-fe43d666-9f67-4113-92da-91ba0ad6438c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 08:14:31.049126 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: WARNING keystonemiddleware.auth_token [None req-3e63c690-e348-4abd-9c71-eae8847464e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 08:14:31.054874 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586424a69c0 pid: 117548 (default app) Jun 21 08:14:31.055833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586424a69c0 pid: 117547 (default app) Jun 21 08:15:15.353082 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2e32bc72-6675-48ef-8e2c-f17bf27e4bc0 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8f64280>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:15.395754 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:15.397082 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:15.398216 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:15.399352 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:16.039780 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2e32bc72-6675-48ef-8e2c-f17bf27e4bc0 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/510624e2-db1d-400c-9db3-376e90f71ac2" status: 200 len: 351 microversion: 2.1 time: 1.128441 Jun 21 08:15:16.041662 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 1/1] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:15:14 2022] GET /compute/v2.1/os-volumes/510624e2-db1d-400c-9db3-376e90f71ac2 => generated 351 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:15:17.958930 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=3 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:17.961433 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=3 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:17.965848 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=3 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:17.968811 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=3 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:18.527404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0f738741-761b-40bc-b446-e073ea401099 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8f02160>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:19.883879 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0f738741-761b-40bc-b446-e073ea401099 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/bd0cf597-e93f-4657-b514-309578cd8009" status: 200 len: 351 microversion: 2.1 time: 1.939561 Jun 21 08:15:19.885618 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 1/2] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:15:17 2022] GET /compute/v2.1/os-volumes/bd0cf597-e93f-4657-b514-309578cd8009 => generated 351 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:15:21.991778 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-50d8ce74-fc4d-45d4-9375-9825705877d2 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8dbb5e0>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:22.129742 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-50d8ce74-fc4d-45d4-9375-9825705877d2 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/5fe2fd3e-7683-4165-9601-41dfbd871d31" status: 200 len: 350 microversion: 2.1 time: 0.148510 Jun 21 08:15:22.130768 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:15:21 2022] GET /compute/v2.1/os-volumes/5fe2fd3e-7683-4165-9601-41dfbd871d31 => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:15:22.163516 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b7ae3469-53f0-4934-bced-c97a98f54ad3 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8dc54c0>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:22.337372 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b7ae3469-53f0-4934-bced-c97a98f54ad3 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.196546 Jun 21 08:15:22.338765 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Jun 21 08:15:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:22.358997 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b40025f3-d746-44fd-8de3-863fbf0905b6 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8dbb790>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:22.655059 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b40025f3-d746-44fd-8de3-863fbf0905b6 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.304728 Jun 21 08:15:22.655891 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Jun 21 08:15:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:15:22.670689 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9b086b18-6e3d-4d40-93c0-acc191022e31 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8d7f0d0>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:22.928343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9b086b18-6e3d-4d40-93c0-acc191022e31 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.262199 Jun 21 08:15:22.929274 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Jun 21 08:15:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:22.941175 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ccdc56a9-ce1e-45ce-a07c-3f13a9a87057 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8d871f0>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:23.186069 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ccdc56a9-ce1e-45ce-a07c-3f13a9a87057 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.249312 Jun 21 08:15:23.187633 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Jun 21 08:15:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:15:23.203484 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8fa354fe-5d77-47fe-89af-901c252a3207 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8dc5c10>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:23.424809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8fa354fe-5d77-47fe-89af-901c252a3207 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.225009 Jun 21 08:15:23.434160 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Jun 21 08:15:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:15:23.440515 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0ccb6a36-7d24-4429-ae94-e803594e9c93 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8dbbdc0>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:23.638347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0ccb6a36-7d24-4429-ae94-e803594e9c93 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.202909 Jun 21 08:15:23.648080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 5/9] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Jun 21 08:15:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:23.652629 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7e5a31bf-a2f4-42b0-a700-f1c048bdac8b tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8d7f430>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:23.853555 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7e5a31bf-a2f4-42b0-a700-f1c048bdac8b tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.206320 Jun 21 08:15:23.855374 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 5/10] 10.222.0.36 () {58 vars in 1187 bytes} [Tue Jun 21 08:15:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:15:23.867792 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2d0b3f5c-7753-461e-a863-562fc4a8f442 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] Calling method '.version_select at 0x7fded8d878b0>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:24.041077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2d0b3f5c-7753-461e-a863-562fc4a8f442 tempest-VolumesTestJSON-118126465 tempest-VolumesTestJSON-118126465-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.177414 Jun 21 08:15:24.042984 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Jun 21 08:15:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:27.424725 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b4db33d6-a9e3-4393-ba9d-cc05953807cc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: .version_select at 0x7fded8dc5550>, body: {"keypair": {"name": "tempest-keypair-375753112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGbbVhUEb2Evq4SyxTjUexoNFurnLBvj5X+qZfZ2hxJgiXcdAucLkbYtlDbKntLV9C5Aob3blZ2TXo8IsZZ9GCui0XnFKUupNIvPYUikkJ8VatFM4OTIvFwsG31WwxVXw=="}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:15:27.561870 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-b4db33d6-a9e3-4393-ba9d-cc05953807cc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'key_pairs'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:15:27.629132 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-b4db33d6-a9e3-4393-ba9d-cc05953807cc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for user de0dccd8f960443894a99baa79198005 and project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'key_pairs'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:15:27.753391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b4db33d6-a9e3-4393-ba9d-cc05953807cc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.826066 Jun 21 08:15:27.754112 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 6/12] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 08:15:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:15:31.961929 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ec138ab2-97d2-4b31-84a5-ca5b45f1dd32 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'create', calling method: .version_select at 0x7fded8dbb820>, body: {"keypair": {"name": "tempest-keypair-1052974073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMHzkjZ8kGqDGMxQn2Mi/QZfMUHigSRiUvUlmA4iNILKRlvlVWfVker8KgkehsEoNeujA9S16zHUfaiLOulauNMYGFx2l4xrCLfXz0y57oBTr2sHNg+WONv/lx0ymhG+Q=="}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:15:32.012476 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-666401784", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "networks": [{"uuid": "91e54668-efe1-4d42-a58f-866649925d1c"}]}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:15:32.143601 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-ec138ab2-97d2-4b31-84a5-ca5b45f1dd32 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Getting quotas for project 9c4b18684de44714b4a54442a17720b7. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:15:32.204650 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-ec138ab2-97d2-4b31-84a5-ca5b45f1dd32 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Getting quotas for user 62c0039007d641c0aedaa781acaa0abe and project 9c4b18684de44714b4a54442a17720b7. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:15:32.255070 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] validate_networks() for [('91e54668-efe1-4d42-a58f-866649925d1c', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:15:32.364566 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ec138ab2-97d2-4b31-84a5-ca5b45f1dd32 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.249583 Jun 21 08:15:32.366228 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 7/13] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 08:15:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:15:33.523863 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-636888594", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:15:33.695053 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.network.neutron [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] validate_networks() for [('98aed940-6352-48a8-ae3d-f07b94cd1263', None, None, None, None, None)] {{(pid=117548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:15:35.918530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:15:35.919044 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:15:35.919447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:15:35.919851 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:15:35.920530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:15:35.950985 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:35.952751 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:35.964144 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:35.966026 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:36.048278 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Getting quotas for project 6f60bd09c67c4a3ba0f96d5367a3cd76. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:15:36.055415 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Getting quotas for user cf94ea4bbf414d2d89cfe3c232f2a54b and project 6f60bd09c67c4a3ba0f96d5367a3cd76. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:15:36.087939 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:15:36.096865 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:15:36.106948 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Flavor limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:15:36.107494 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Image limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:15:36.107893 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Flavor pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:15:36.108474 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Image pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:15:36.108903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:15:36.141619 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:36.142209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:36.148512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:36.148970 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:36.270135 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Getting quotas for project 2001b029fae0472d8ef7b6fd658ad191. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:15:36.282496 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Getting quotas for user 771f36afce0a4dd8897bb22f3c330856 and project 2001b029fae0472d8ef7b6fd658ad191. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:15:36.314063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1c6fe663-708e-4811-97fa-13c63d088086 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.871311 Jun 21 08:15:36.322106 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 7/14] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:15:36.341059 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-126ea484-6e40-4e1c-abad-21ee594f2316 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:36.341714 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-126ea484-6e40-4e1c-abad-21ee594f2316 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:36.365755 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Going to run 1 instances... {{(pid=117548) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:15:36.380863 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:15:36.697396 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2c6811b2-7dfb-4205-8a06-692f0652491b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.627209 Jun 21 08:15:36.703121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 8/15] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:15:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 3635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:15:36.717550 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f1453f6c-8d42-4fda-b137-494e98bb7f8a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:36.720277 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f1453f6c-8d42-4fda-b137-494e98bb7f8a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:36.860081 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-126ea484-6e40-4e1c-abad-21ee594f2316 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:36.888114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-126ea484-6e40-4e1c-abad-21ee594f2316 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1214 microversion: 2.1 time: 0.558455 Jun 21 08:15:36.890293 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:36 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1214 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:37.004891 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f1453f6c-8d42-4fda-b137-494e98bb7f8a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:37.071251 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f1453f6c-8d42-4fda-b137-494e98bb7f8a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1221 microversion: 2.1 time: 0.365308 Jun 21 08:15:37.090601 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 9/17] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:36 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1221 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:37.450568 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1665056744", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbf78e3a-7b50-434f-bb05-1e295b095c9f"}], "security_groups": [{"name": "tempest-securitygroup--1043765557"}], "key_name": "tempest-keypair-375753112", "user_data": "}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:15:37.713232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-983305980", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:15:37.807131 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] validate_networks() for [('bbf78e3a-7b50-434f-bb05-1e295b095c9f', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:15:37.859872 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.network.neutron [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] validate_networks() for [('98aed940-6352-48a8-ae3d-f07b94cd1263', None, None, None, None, None)] {{(pid=117548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:15:38.989463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:15:38.990457 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:15:38.991129 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:15:38.992043 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:15:38.992471 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:15:39.022436 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:39.023756 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:39.026448 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:39.027060 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:39.073740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:15:39.085202 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for user de0dccd8f960443894a99baa79198005 and project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:15:39.112792 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:15:39.116161 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:15:39.239147 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-bbd7b051-d888-4932-a47f-2537235f640b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.794136 Jun 21 08:15:39.242549 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 9/18] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:15:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 08:15:39.274758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1940224a-d2dc-4cf6-b4d8-aa6e0d0b534f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:39.278878 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1940224a-d2dc-4cf6-b4d8-aa6e0d0b534f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:39.306883 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1940224a-d2dc-4cf6-b4d8-aa6e0d0b534f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:39.308917 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1940224a-d2dc-4cf6-b4d8-aa6e0d0b534f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:39.311717 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1940224a-d2dc-4cf6-b4d8-aa6e0d0b534f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:39.313272 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1940224a-d2dc-4cf6-b4d8-aa6e0d0b534f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:39.652888 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1940224a-d2dc-4cf6-b4d8-aa6e0d0b534f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:39.675630 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1940224a-d2dc-4cf6-b4d8-aa6e0d0b534f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1266 microversion: 2.1 time: 0.430024 Jun 21 08:15:39.687428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 10/19] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:39 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1266 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:39.693530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-79f54f86-68b7-4d63-a3c4-cfb68efdc69b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:39.694428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-79f54f86-68b7-4d63-a3c4-cfb68efdc69b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:39.770856 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-79f54f86-68b7-4d63-a3c4-cfb68efdc69b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:39.781141 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-79f54f86-68b7-4d63-a3c4-cfb68efdc69b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1241 microversion: 2.1 time: 0.091910 Jun 21 08:15:39.785379 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 11/20] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:39 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:39.792202 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-806058577", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1563a5ad-132e-4800-8264-c4bbc3c987e3"}], "security_groups": [{"name": "tempest-securitygroup--1467164923"}], "key_name": "tempest-keypair-1052974073", "user_data": "}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:15:40.051799 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] validate_networks() for [('1563a5ad-132e-4800-8264-c4bbc3c987e3', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:15:40.060923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Flavor limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:15:40.065032 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Image limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:15:40.067793 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Flavor pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:15:40.069240 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Image pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:15:40.072267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:15:40.153272 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:40.153735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:40.154836 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:40.155387 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:40.233394 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Getting quotas for project 2001b029fae0472d8ef7b6fd658ad191. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:15:40.248205 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Getting quotas for user 771f36afce0a4dd8897bb22f3c330856 and project 2001b029fae0472d8ef7b6fd658ad191. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:15:40.286610 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Going to run 1 instances... {{(pid=117548) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:15:40.288814 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:15:40.507708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9adf70a8-ff43-4ae6-82d3-afdcc79e30e4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.806909 Jun 21 08:15:40.514869 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 10/21] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:15:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:15:40.525968 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-be570cf5-4e9c-41f2-aaac-88000dec765f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:40.540602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-be570cf5-4e9c-41f2-aaac-88000dec765f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:40.777499 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-be570cf5-4e9c-41f2-aaac-88000dec765f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:40.790648 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-be570cf5-4e9c-41f2-aaac-88000dec765f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1221 microversion: 2.1 time: 0.274569 Jun 21 08:15:40.793348 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 11/22] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:40 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1221 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:40.832605 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4045b6af-a587-4567-a4d3-cdca93258a7c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:40.842542 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4045b6af-a587-4567-a4d3-cdca93258a7c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:40.876027 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4045b6af-a587-4567-a4d3-cdca93258a7c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:40.882407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4045b6af-a587-4567-a4d3-cdca93258a7c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:40.886131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4045b6af-a587-4567-a4d3-cdca93258a7c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:40.886869 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4045b6af-a587-4567-a4d3-cdca93258a7c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:41.773881 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4045b6af-a587-4567-a4d3-cdca93258a7c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:41.797602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4045b6af-a587-4567-a4d3-cdca93258a7c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1272 microversion: 2.1 time: 1.000122 Jun 21 08:15:41.808358 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:40 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1272 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:41.826881 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e5fb0243-da6e-4662-9d64-ed70eedd9711 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:41.828039 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e5fb0243-da6e-4662-9d64-ed70eedd9711 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:41.838748 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e5fb0243-da6e-4662-9d64-ed70eedd9711 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:41.839775 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e5fb0243-da6e-4662-9d64-ed70eedd9711 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:41.841297 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e5fb0243-da6e-4662-9d64-ed70eedd9711 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:41.841924 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e5fb0243-da6e-4662-9d64-ed70eedd9711 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:41.996459 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:15:41.997096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:15:41.997539 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:15:41.998264 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:15:41.998770 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:15:42.044351 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e5fb0243-da6e-4662-9d64-ed70eedd9711 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:42.044993 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:42.046016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:42.051489 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:42.052935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e5fb0243-da6e-4662-9d64-ed70eedd9711 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1301 microversion: 2.1 time: 0.234484 Jun 21 08:15:42.055583 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:42.069875 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 13/24] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:41 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1301 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:42.087653 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a84a5a38-02b1-4663-9854-22be548cfa73 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:42.096828 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a84a5a38-02b1-4663-9854-22be548cfa73 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:42.131450 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a84a5a38-02b1-4663-9854-22be548cfa73 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:42.132759 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a84a5a38-02b1-4663-9854-22be548cfa73 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:42.133900 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a84a5a38-02b1-4663-9854-22be548cfa73 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:42.137805 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Getting quotas for project 9c4b18684de44714b4a54442a17720b7. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:15:42.139298 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a84a5a38-02b1-4663-9854-22be548cfa73 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:42.152284 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Getting quotas for user 62c0039007d641c0aedaa781acaa0abe and project 9c4b18684de44714b4a54442a17720b7. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:15:42.204453 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:15:42.216652 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:15:42.359412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a84a5a38-02b1-4663-9854-22be548cfa73 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:42.371961 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a84a5a38-02b1-4663-9854-22be548cfa73 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1217 microversion: 2.1 time: 0.300911 Jun 21 08:15:42.373383 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 14/25] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:42 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1217 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:42.386786 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d85eec3e-6acf-46d7-a4a0-44da8df6a496 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.597466 Jun 21 08:15:42.389590 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 12/26] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:15:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 2603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:15:42.399928 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2e7705b3-a4e5-4ed4-8dc9-6f8123bc3ebc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:42.400750 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2e7705b3-a4e5-4ed4-8dc9-6f8123bc3ebc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:42.696486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2e7705b3-a4e5-4ed4-8dc9-6f8123bc3ebc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:42.712197 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2e7705b3-a4e5-4ed4-8dc9-6f8123bc3ebc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1237 microversion: 2.1 time: 0.316435 Jun 21 08:15:42.729278 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 15/27] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:42 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1237 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:42.818532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4dce221f-12f2-485d-b8dc-72eb11620008 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:42.819253 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4dce221f-12f2-485d-b8dc-72eb11620008 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:42.854902 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4dce221f-12f2-485d-b8dc-72eb11620008 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:42.855183 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4dce221f-12f2-485d-b8dc-72eb11620008 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:42.864692 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4dce221f-12f2-485d-b8dc-72eb11620008 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:42.880376 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4dce221f-12f2-485d-b8dc-72eb11620008 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:43.074868 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-cf27ca0d-4876-4f6a-ac78-959d4352ccd3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:43.079110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-cf27ca0d-4876-4f6a-ac78-959d4352ccd3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:43.116801 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cf27ca0d-4876-4f6a-ac78-959d4352ccd3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:43.117307 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cf27ca0d-4876-4f6a-ac78-959d4352ccd3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:43.133841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cf27ca0d-4876-4f6a-ac78-959d4352ccd3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:43.134318 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cf27ca0d-4876-4f6a-ac78-959d4352ccd3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:43.347796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4dce221f-12f2-485d-b8dc-72eb11620008 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:43.377299 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4dce221f-12f2-485d-b8dc-72eb11620008 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1272 microversion: 2.1 time: 0.564632 Jun 21 08:15:43.380824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 13/28] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:42 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1272 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:43.409584 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9a1a6ebd-15a0-4393-94b4-a091ef056ef3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:43.414072 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9a1a6ebd-15a0-4393-94b4-a091ef056ef3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:43.442295 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9a1a6ebd-15a0-4393-94b4-a091ef056ef3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:43.450647 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9a1a6ebd-15a0-4393-94b4-a091ef056ef3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:43.453679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9a1a6ebd-15a0-4393-94b4-a091ef056ef3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:43.459398 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9a1a6ebd-15a0-4393-94b4-a091ef056ef3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:43.593543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-cf27ca0d-4876-4f6a-ac78-959d4352ccd3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:43.605244 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-cf27ca0d-4876-4f6a-ac78-959d4352ccd3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1299 microversion: 2.1 time: 0.535938 Jun 21 08:15:43.627138 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 16/29] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:43 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1299 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:43.746583 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-99f52bdf-2541-4d9e-9748-070308a97959 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:43.747288 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-99f52bdf-2541-4d9e-9748-070308a97959 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:43.786316 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-99f52bdf-2541-4d9e-9748-070308a97959 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:43.788064 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-99f52bdf-2541-4d9e-9748-070308a97959 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:43.793547 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-99f52bdf-2541-4d9e-9748-070308a97959 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:43.795311 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-99f52bdf-2541-4d9e-9748-070308a97959 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:43.904639 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9a1a6ebd-15a0-4393-94b4-a091ef056ef3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:43.925407 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9a1a6ebd-15a0-4393-94b4-a091ef056ef3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1279 microversion: 2.1 time: 0.524678 Jun 21 08:15:43.926796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 14/30] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:43 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1279 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:44.189117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-99f52bdf-2541-4d9e-9748-070308a97959 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:44.201988 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-99f52bdf-2541-4d9e-9748-070308a97959 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1241 microversion: 2.1 time: 0.459359 Jun 21 08:15:44.208069 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 17/31] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:43 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1241 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:44.399299 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e736ebb6-b9a3-4f10-b967-eb10f6780165 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:44.400010 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e736ebb6-b9a3-4f10-b967-eb10f6780165 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:44.431091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e736ebb6-b9a3-4f10-b967-eb10f6780165 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:44.434183 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e736ebb6-b9a3-4f10-b967-eb10f6780165 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:44.436059 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e736ebb6-b9a3-4f10-b967-eb10f6780165 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:44.437969 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e736ebb6-b9a3-4f10-b967-eb10f6780165 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:44.634493 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7ba97dff-2bc0-48b4-9db0-75fe35723e32 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:44.635304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-7ba97dff-2bc0-48b4-9db0-75fe35723e32 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:44.651786 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7ba97dff-2bc0-48b4-9db0-75fe35723e32 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:44.652576 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7ba97dff-2bc0-48b4-9db0-75fe35723e32 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:44.654527 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7ba97dff-2bc0-48b4-9db0-75fe35723e32 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:44.655220 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7ba97dff-2bc0-48b4-9db0-75fe35723e32 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:44.737219 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e736ebb6-b9a3-4f10-b967-eb10f6780165 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:44.746482 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e736ebb6-b9a3-4f10-b967-eb10f6780165 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1272 microversion: 2.1 time: 0.351490 Jun 21 08:15:44.759523 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 15/32] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:44 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1272 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:44.945415 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-867f964d-f2d7-4ec7-bb6f-2cb1d260e7ee tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:44.946281 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-867f964d-f2d7-4ec7-bb6f-2cb1d260e7ee tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:44.982010 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-867f964d-f2d7-4ec7-bb6f-2cb1d260e7ee tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:44.982530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-867f964d-f2d7-4ec7-bb6f-2cb1d260e7ee tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:44.984592 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-867f964d-f2d7-4ec7-bb6f-2cb1d260e7ee tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:44.987123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-867f964d-f2d7-4ec7-bb6f-2cb1d260e7ee tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:45.276347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-7ba97dff-2bc0-48b4-9db0-75fe35723e32 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:45.304702 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7ba97dff-2bc0-48b4-9db0-75fe35723e32 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1299 microversion: 2.1 time: 0.659013 Jun 21 08:15:45.308158 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 18/33] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:44 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1299 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:45.337976 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7681c067-3e2a-4701-b00c-cc4b9d67f342 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:45.340864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-7681c067-3e2a-4701-b00c-cc4b9d67f342 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:45.380221 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7681c067-3e2a-4701-b00c-cc4b9d67f342 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:45.389251 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7681c067-3e2a-4701-b00c-cc4b9d67f342 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:45.391543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7681c067-3e2a-4701-b00c-cc4b9d67f342 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:45.394550 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7681c067-3e2a-4701-b00c-cc4b9d67f342 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:45.655355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-867f964d-f2d7-4ec7-bb6f-2cb1d260e7ee tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:45.667855 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-867f964d-f2d7-4ec7-bb6f-2cb1d260e7ee tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1279 microversion: 2.1 time: 0.727414 Jun 21 08:15:45.674981 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 16/34] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:44 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1279 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:45.784530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0e2cf2ec-393f-4b83-b380-96147aa5921f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:45.785181 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0e2cf2ec-393f-4b83-b380-96147aa5921f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:45.802593 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0e2cf2ec-393f-4b83-b380-96147aa5921f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:45.820932 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0e2cf2ec-393f-4b83-b380-96147aa5921f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:45.821885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0e2cf2ec-393f-4b83-b380-96147aa5921f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:45.835696 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0e2cf2ec-393f-4b83-b380-96147aa5921f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:46.097049 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0e2cf2ec-393f-4b83-b380-96147aa5921f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:46.107190 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0e2cf2ec-393f-4b83-b380-96147aa5921f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1272 microversion: 2.1 time: 0.334394 Jun 21 08:15:46.122806 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 17/35] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:45 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:46.250521 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-7681c067-3e2a-4701-b00c-cc4b9d67f342 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:46.263113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7681c067-3e2a-4701-b00c-cc4b9d67f342 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1297 microversion: 2.1 time: 0.953396 Jun 21 08:15:46.263890 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 19/36] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:45 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1297 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:46.326399 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a893b53f-02e3-4f84-836a-2bc031dfcc0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:46.327498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a893b53f-02e3-4f84-836a-2bc031dfcc0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:46.348273 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a893b53f-02e3-4f84-836a-2bc031dfcc0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:46.352133 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a893b53f-02e3-4f84-836a-2bc031dfcc0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:46.355087 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a893b53f-02e3-4f84-836a-2bc031dfcc0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:46.355702 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a893b53f-02e3-4f84-836a-2bc031dfcc0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:46.633732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a893b53f-02e3-4f84-836a-2bc031dfcc0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:46.668275 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a893b53f-02e3-4f84-836a-2bc031dfcc0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1299 microversion: 2.1 time: 0.330636 Jun 21 08:15:46.668275 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 18/37] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:46 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1299 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:46.687741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-579d9c6d-f15b-4bde-b11b-89f4bcecf3c4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:46.688569 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-579d9c6d-f15b-4bde-b11b-89f4bcecf3c4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:46.716309 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-579d9c6d-f15b-4bde-b11b-89f4bcecf3c4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:46.720957 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-579d9c6d-f15b-4bde-b11b-89f4bcecf3c4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:46.727643 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-579d9c6d-f15b-4bde-b11b-89f4bcecf3c4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:46.727643 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-579d9c6d-f15b-4bde-b11b-89f4bcecf3c4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:46.900964 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-579d9c6d-f15b-4bde-b11b-89f4bcecf3c4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:46.913363 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-579d9c6d-f15b-4bde-b11b-89f4bcecf3c4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1279 microversion: 2.1 time: 0.231117 Jun 21 08:15:46.915744 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 20/38] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:46 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:47.132940 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a07a9746-97a0-4a19-ac6e-ce8cbb10fcf3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:47.133856 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a07a9746-97a0-4a19-ac6e-ce8cbb10fcf3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:47.154364 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a07a9746-97a0-4a19-ac6e-ce8cbb10fcf3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:47.156066 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a07a9746-97a0-4a19-ac6e-ce8cbb10fcf3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:47.157308 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a07a9746-97a0-4a19-ac6e-ce8cbb10fcf3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:47.159256 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a07a9746-97a0-4a19-ac6e-ce8cbb10fcf3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:47.292392 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-126c083b-7174-4a93-b70e-a4fe67cf6bd4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:47.295754 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-126c083b-7174-4a93-b70e-a4fe67cf6bd4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:47.316749 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-126c083b-7174-4a93-b70e-a4fe67cf6bd4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:47.320653 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-126c083b-7174-4a93-b70e-a4fe67cf6bd4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:47.322719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-126c083b-7174-4a93-b70e-a4fe67cf6bd4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:47.326070 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-126c083b-7174-4a93-b70e-a4fe67cf6bd4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:48.117596 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a07a9746-97a0-4a19-ac6e-ce8cbb10fcf3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:48.126431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a07a9746-97a0-4a19-ac6e-ce8cbb10fcf3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.999732 Jun 21 08:15:48.148187 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 19/39] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:47 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:48.159490 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-bd978a91-3dac-47b4-a2e9-d04044222bfb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:48.161437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-bd978a91-3dac-47b4-a2e9-d04044222bfb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:48.183102 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bd978a91-3dac-47b4-a2e9-d04044222bfb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:48.185035 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bd978a91-3dac-47b4-a2e9-d04044222bfb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:48.185946 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bd978a91-3dac-47b4-a2e9-d04044222bfb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:48.187370 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bd978a91-3dac-47b4-a2e9-d04044222bfb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:48.390904 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-126c083b-7174-4a93-b70e-a4fe67cf6bd4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:48.420326 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-126c083b-7174-4a93-b70e-a4fe67cf6bd4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1295 microversion: 2.1 time: 1.142206 Jun 21 08:15:48.420936 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 21/40] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:47 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1295 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:48.436318 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-023e215e-7b5a-4000-bf21-dd2356d5aaa3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:48.441252 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-023e215e-7b5a-4000-bf21-dd2356d5aaa3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:48.484575 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-023e215e-7b5a-4000-bf21-dd2356d5aaa3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:48.485047 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-023e215e-7b5a-4000-bf21-dd2356d5aaa3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:48.485864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-023e215e-7b5a-4000-bf21-dd2356d5aaa3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:48.499002 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-023e215e-7b5a-4000-bf21-dd2356d5aaa3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:48.978654 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-023e215e-7b5a-4000-bf21-dd2356d5aaa3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:48.987380 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-023e215e-7b5a-4000-bf21-dd2356d5aaa3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1279 microversion: 2.1 time: 0.565396 Jun 21 08:15:48.996629 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 22/41] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:48 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1279 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:49.053749 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-bd978a91-3dac-47b4-a2e9-d04044222bfb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:49.070403 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-bd978a91-3dac-47b4-a2e9-d04044222bfb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.920058 Jun 21 08:15:49.073737 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 20/42] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:48 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:49.155873 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f228799d-cac3-42f2-adcf-449954141cd8 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:49.156603 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f228799d-cac3-42f2-adcf-449954141cd8 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:49.169147 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f228799d-cac3-42f2-adcf-449954141cd8 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:49.170221 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f228799d-cac3-42f2-adcf-449954141cd8 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:49.176661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f228799d-cac3-42f2-adcf-449954141cd8 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:49.177345 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f228799d-cac3-42f2-adcf-449954141cd8 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:49.437301 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-657a0f15-e42b-4c5c-9bfb-635b0be5b293 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:49.437926 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-657a0f15-e42b-4c5c-9bfb-635b0be5b293 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:49.440735 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:49.468545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-657a0f15-e42b-4c5c-9bfb-635b0be5b293 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:49.469637 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-657a0f15-e42b-4c5c-9bfb-635b0be5b293 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:49.472519 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-657a0f15-e42b-4c5c-9bfb-635b0be5b293 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:49.474171 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-657a0f15-e42b-4c5c-9bfb-635b0be5b293 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:49.919234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-657a0f15-e42b-4c5c-9bfb-635b0be5b293 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:49.934026 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-657a0f15-e42b-4c5c-9bfb-635b0be5b293 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1295 microversion: 2.1 time: 0.497738 Jun 21 08:15:49.943394 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 21/43] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:49 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1295 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:50.013767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7dc11eae-73c8-43cc-a52b-4de51f11a15f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:50.014708 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7dc11eae-73c8-43cc-a52b-4de51f11a15f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:50.032443 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7dc11eae-73c8-43cc-a52b-4de51f11a15f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:50.033148 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7dc11eae-73c8-43cc-a52b-4de51f11a15f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:50.034164 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7dc11eae-73c8-43cc-a52b-4de51f11a15f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:50.035281 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7dc11eae-73c8-43cc-a52b-4de51f11a15f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:50.187376 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=4 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:50.464777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f228799d-cac3-42f2-adcf-449954141cd8 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:50.478148 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7dc11eae-73c8-43cc-a52b-4de51f11a15f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:50.483517 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f228799d-cac3-42f2-adcf-449954141cd8 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 1.331790 Jun 21 08:15:50.491174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 23/44] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:49 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:50.502710 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7dc11eae-73c8-43cc-a52b-4de51f11a15f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1279 microversion: 2.1 time: 0.480110 Jun 21 08:15:50.503352 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 22/45] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:50 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1279 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:50.504091 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4394436f-bc43-43f5-ba8f-86e2534f210c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:50.505056 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4394436f-bc43-43f5-ba8f-86e2534f210c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:50.513763 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4394436f-bc43-43f5-ba8f-86e2534f210c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:50.514513 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4394436f-bc43-43f5-ba8f-86e2534f210c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:50.519396 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4394436f-bc43-43f5-ba8f-86e2534f210c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:50.520374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4394436f-bc43-43f5-ba8f-86e2534f210c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:50.746920 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-0d3de1c6-92f2-4baa-bd32-edd8636a4708 req-8edd950c-ce8d-4a4a-bef7-fce767ad8676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe8e00a-97d1-4e7c-8a02-db6a981670fc", "tag": "401a4b2e-926f-405f-af0e-bb07243e04fc"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:15:50.770996 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-0d3de1c6-92f2-4baa-bd32-edd8636a4708 req-8edd950c-ce8d-4a4a-bef7-fce767ad8676 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:50.771452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-0d3de1c6-92f2-4baa-bd32-edd8636a4708 req-8edd950c-ce8d-4a4a-bef7-fce767ad8676 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:50.793962 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-0d3de1c6-92f2-4baa-bd32-edd8636a4708 req-8edd950c-ce8d-4a4a-bef7-fce767ad8676 service nova] Creating event network-changed:401a4b2e-926f-405f-af0e-bb07243e04fc for instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc on hv-cinder-83697 Jun 21 08:15:50.794499 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-0d3de1c6-92f2-4baa-bd32-edd8636a4708 req-8edd950c-ce8d-4a4a-bef7-fce767ad8676 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 08:15:50.803629 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01ab1429-cc57-40ff-b3e3-94e8d7f2f730 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:50.804328 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01ab1429-cc57-40ff-b3e3-94e8d7f2f730 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:50.823546 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01ab1429-cc57-40ff-b3e3-94e8d7f2f730 None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:50.824008 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01ab1429-cc57-40ff-b3e3-94e8d7f2f730 None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:50.844295 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.compute.rpcapi [None req-01ab1429-cc57-40ff-b3e3-94e8d7f2f730 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 08:15:50.845216 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01ab1429-cc57-40ff-b3e3-94e8d7f2f730 None None] Releasing lock "compute-rpcapi-router" {{(pid=117547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 08:15:50.907291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-01ab1429-cc57-40ff-b3e3-94e8d7f2f730 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.402651 Jun 21 08:15:50.908709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 23/46] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:15:50.961452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7c38ca95-2932-44aa-b3ce-68ddf8dd52ae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:50.963246 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7c38ca95-2932-44aa-b3ce-68ddf8dd52ae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:50.971628 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7c38ca95-2932-44aa-b3ce-68ddf8dd52ae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:50.972350 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7c38ca95-2932-44aa-b3ce-68ddf8dd52ae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:50.973357 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7c38ca95-2932-44aa-b3ce-68ddf8dd52ae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:50.974033 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7c38ca95-2932-44aa-b3ce-68ddf8dd52ae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:51.257239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7c38ca95-2932-44aa-b3ce-68ddf8dd52ae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:51.282421 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7c38ca95-2932-44aa-b3ce-68ddf8dd52ae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1295 microversion: 2.1 time: 0.324156 Jun 21 08:15:51.293054 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 24/47] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:50 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1295 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:51.510723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-634d83f7-583b-413c-b3c2-f9ff948d27de tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:51.512075 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-634d83f7-583b-413c-b3c2-f9ff948d27de tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:51.526991 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-634d83f7-583b-413c-b3c2-f9ff948d27de tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:51.537244 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-634d83f7-583b-413c-b3c2-f9ff948d27de tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:51.538519 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-634d83f7-583b-413c-b3c2-f9ff948d27de tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:51.539181 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-634d83f7-583b-413c-b3c2-f9ff948d27de tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:51.747205 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4394436f-bc43-43f5-ba8f-86e2534f210c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:51.756131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4394436f-bc43-43f5-ba8f-86e2534f210c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 1.262858 Jun 21 08:15:51.759385 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 24/48] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:50 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:51.772623 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d978b70a-ce2e-4a70-abec-677258503f43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:51.773365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d978b70a-ce2e-4a70-abec-677258503f43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:51.781682 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d978b70a-ce2e-4a70-abec-677258503f43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:51.784592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d978b70a-ce2e-4a70-abec-677258503f43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:51.785589 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d978b70a-ce2e-4a70-abec-677258503f43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:51.788289 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d978b70a-ce2e-4a70-abec-677258503f43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:51.966746 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d978b70a-ce2e-4a70-abec-677258503f43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:51.975505 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d978b70a-ce2e-4a70-abec-677258503f43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1279 microversion: 2.1 time: 0.214968 Jun 21 08:15:51.979030 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 25/49] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:51 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1279 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:52.184172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=26 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:52.269318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-634d83f7-583b-413c-b3c2-f9ff948d27de tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:52.277914 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-634d83f7-583b-413c-b3c2-f9ff948d27de tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.772841 Jun 21 08:15:52.281396 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 25/50] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:51 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:52.306161 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-95b621fa-80af-43db-a9ca-129db177f4fc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:52.308525 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-95b621fa-80af-43db-a9ca-129db177f4fc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:52.318880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-95b621fa-80af-43db-a9ca-129db177f4fc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:52.319807 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-95b621fa-80af-43db-a9ca-129db177f4fc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:52.321800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-95b621fa-80af-43db-a9ca-129db177f4fc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:52.323101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-95b621fa-80af-43db-a9ca-129db177f4fc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:52.522731 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-95b621fa-80af-43db-a9ca-129db177f4fc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:52.585662 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-95b621fa-80af-43db-a9ca-129db177f4fc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1295 microversion: 2.1 time: 0.289100 Jun 21 08:15:52.588449 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 26/51] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:52 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1295 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:52.787420 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-38156cd8-f2c2-473b-94b4-a7175cedd907 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:52.788026 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-38156cd8-f2c2-473b-94b4-a7175cedd907 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:52.805248 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-38156cd8-f2c2-473b-94b4-a7175cedd907 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:52.805697 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-38156cd8-f2c2-473b-94b4-a7175cedd907 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:52.812092 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-38156cd8-f2c2-473b-94b4-a7175cedd907 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:52.812409 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-38156cd8-f2c2-473b-94b4-a7175cedd907 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:52.995901 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1d302c2d-59ee-469f-ad3c-9da4ac0a7b4c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:52.996525 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1d302c2d-59ee-469f-ad3c-9da4ac0a7b4c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:52.998887 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=22 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:53.011340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1d302c2d-59ee-469f-ad3c-9da4ac0a7b4c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:53.011858 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1d302c2d-59ee-469f-ad3c-9da4ac0a7b4c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:53.012747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1d302c2d-59ee-469f-ad3c-9da4ac0a7b4c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:53.013279 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1d302c2d-59ee-469f-ad3c-9da4ac0a7b4c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:54.242687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1d302c2d-59ee-469f-ad3c-9da4ac0a7b4c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:54.263142 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1d302c2d-59ee-469f-ad3c-9da4ac0a7b4c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 1.270977 Jun 21 08:15:54.280148 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 27/52] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:52 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:54.298570 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-38156cd8-f2c2-473b-94b4-a7175cedd907 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:54.304169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d9f59690-1958-4a04-8a1f-396c3e3e24ae tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:54.307542 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d9f59690-1958-4a04-8a1f-396c3e3e24ae tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:54.314407 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-38156cd8-f2c2-473b-94b4-a7175cedd907 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 1.528143 Jun 21 08:15:54.324231 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 26/53] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:52 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:54.327538 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0f214b98-df86-4d41-876d-360781861961 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:54.328503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0f214b98-df86-4d41-876d-360781861961 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:54.339131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d9f59690-1958-4a04-8a1f-396c3e3e24ae tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:54.340119 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0f214b98-df86-4d41-876d-360781861961 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:54.340614 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0f214b98-df86-4d41-876d-360781861961 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:54.341382 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0f214b98-df86-4d41-876d-360781861961 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:54.343903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d9f59690-1958-4a04-8a1f-396c3e3e24ae tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:54.345228 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d9f59690-1958-4a04-8a1f-396c3e3e24ae tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:54.346291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0f214b98-df86-4d41-876d-360781861961 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:54.348519 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d9f59690-1958-4a04-8a1f-396c3e3e24ae tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:54.947989 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0f214b98-df86-4d41-876d-360781861961 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:54.957586 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:54.972122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0f214b98-df86-4d41-876d-360781861961 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.655326 Jun 21 08:15:54.974695 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 27/54] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:54 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:55.284534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-767865f9-61b8-4773-8861-ef20f1369df4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:55.285148 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-767865f9-61b8-4773-8861-ef20f1369df4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:55.294185 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-767865f9-61b8-4773-8861-ef20f1369df4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:55.296554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-767865f9-61b8-4773-8861-ef20f1369df4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:55.299805 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-767865f9-61b8-4773-8861-ef20f1369df4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:55.301121 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-767865f9-61b8-4773-8861-ef20f1369df4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:55.523913 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-767865f9-61b8-4773-8861-ef20f1369df4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:55.534608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-767865f9-61b8-4773-8861-ef20f1369df4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.254350 Jun 21 08:15:55.545423 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 28/55] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:55 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:55.551772 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e4eff8ad-1c24-426d-9958-516c0fc89d79 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:55.552605 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e4eff8ad-1c24-426d-9958-516c0fc89d79 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:55.561471 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e4eff8ad-1c24-426d-9958-516c0fc89d79 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:55.562085 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e4eff8ad-1c24-426d-9958-516c0fc89d79 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:55.563663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e4eff8ad-1c24-426d-9958-516c0fc89d79 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:55.565068 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e4eff8ad-1c24-426d-9958-516c0fc89d79 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:55.565341 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d9f59690-1958-4a04-8a1f-396c3e3e24ae tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:55.572862 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=100 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:55.584481 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d9f59690-1958-4a04-8a1f-396c3e3e24ae tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 1.301373 Jun 21 08:15:55.585344 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 28/56] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:54 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:55.887968 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e4eff8ad-1c24-426d-9958-516c0fc89d79 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:55.914096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e4eff8ad-1c24-426d-9958-516c0fc89d79 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.373856 Jun 21 08:15:55.916904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 29/57] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:55 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:55.993160 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-df92675d-a38b-4018-9660-c65428894932 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:55.993897 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-df92675d-a38b-4018-9660-c65428894932 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:56.007203 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-df92675d-a38b-4018-9660-c65428894932 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:56.007697 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-df92675d-a38b-4018-9660-c65428894932 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:56.015577 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-df92675d-a38b-4018-9660-c65428894932 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:56.016226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-df92675d-a38b-4018-9660-c65428894932 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:56.554859 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ec4dac0a-90f3-4c10-a917-52b08f0227a1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:56.556768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ec4dac0a-90f3-4c10-a917-52b08f0227a1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:56.563574 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ec4dac0a-90f3-4c10-a917-52b08f0227a1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:56.565093 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ec4dac0a-90f3-4c10-a917-52b08f0227a1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:56.566332 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ec4dac0a-90f3-4c10-a917-52b08f0227a1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:56.567012 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ec4dac0a-90f3-4c10-a917-52b08f0227a1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:56.759445 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ec4dac0a-90f3-4c10-a917-52b08f0227a1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:56.773329 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ec4dac0a-90f3-4c10-a917-52b08f0227a1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.223395 Jun 21 08:15:56.773934 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 30/58] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:56 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:56.790226 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c5eb248e-da03-46d6-bed6-7e9bafda9e1c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:56.796386 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c5eb248e-da03-46d6-bed6-7e9bafda9e1c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:56.806351 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c5eb248e-da03-46d6-bed6-7e9bafda9e1c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:56.807099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c5eb248e-da03-46d6-bed6-7e9bafda9e1c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:56.808665 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c5eb248e-da03-46d6-bed6-7e9bafda9e1c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:56.809333 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c5eb248e-da03-46d6-bed6-7e9bafda9e1c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:57.004119 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-df92675d-a38b-4018-9660-c65428894932 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:57.012198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-df92675d-a38b-4018-9660-c65428894932 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 1.024699 Jun 21 08:15:57.013536 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 29/59] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:55 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:57.028724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-565cd159-387c-41e6-84e6-a1754ddd8f7f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:57.031282 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-565cd159-387c-41e6-84e6-a1754ddd8f7f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:57.046488 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-565cd159-387c-41e6-84e6-a1754ddd8f7f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:57.047342 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-565cd159-387c-41e6-84e6-a1754ddd8f7f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:57.049012 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-565cd159-387c-41e6-84e6-a1754ddd8f7f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:57.057199 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-565cd159-387c-41e6-84e6-a1754ddd8f7f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:57.356667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c5eb248e-da03-46d6-bed6-7e9bafda9e1c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:57.371681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c5eb248e-da03-46d6-bed6-7e9bafda9e1c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.585426 Jun 21 08:15:57.372765 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 31/60] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:56 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:57.902463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-ec4614fb-50a6-4f02-bcbc-049a4276646d req-ac6622ae-390c-407e-8dd3-22b42f8a34f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c08d704-c754-4c7d-b0f4-540ebde6c782", "tag": "e7af3654-e669-4deb-a185-42a54ed5e149"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:15:57.918125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-ec4614fb-50a6-4f02-bcbc-049a4276646d req-ac6622ae-390c-407e-8dd3-22b42f8a34f9 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:57.921367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-ec4614fb-50a6-4f02-bcbc-049a4276646d req-ac6622ae-390c-407e-8dd3-22b42f8a34f9 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:57.934549 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-ec4614fb-50a6-4f02-bcbc-049a4276646d req-ac6622ae-390c-407e-8dd3-22b42f8a34f9 service nova] Creating event network-changed:e7af3654-e669-4deb-a185-42a54ed5e149 for instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 on hv-cinder-83697 Jun 21 08:15:57.950900 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-ec4614fb-50a6-4f02-bcbc-049a4276646d req-ac6622ae-390c-407e-8dd3-22b42f8a34f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318618 Jun 21 08:15:57.951794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 32/61] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:15:57.957308 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9a81868c-8cb6-4924-bbe4-12e2696d6124 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:57.958016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9a81868c-8cb6-4924-bbe4-12e2696d6124 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:57.964514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9a81868c-8cb6-4924-bbe4-12e2696d6124 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:57.964960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9a81868c-8cb6-4924-bbe4-12e2696d6124 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:57.965946 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9a81868c-8cb6-4924-bbe4-12e2696d6124 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:57.966557 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9a81868c-8cb6-4924-bbe4-12e2696d6124 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:57.983972 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-565cd159-387c-41e6-84e6-a1754ddd8f7f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:57.997983 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-565cd159-387c-41e6-84e6-a1754ddd8f7f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.982260 Jun 21 08:15:57.998859 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 30/62] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:57 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:58.031213 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4e407c41-2705-47ef-a637-e5f16f50fa38 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:58.031848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4e407c41-2705-47ef-a637-e5f16f50fa38 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:58.040231 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e407c41-2705-47ef-a637-e5f16f50fa38 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:58.040687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e407c41-2705-47ef-a637-e5f16f50fa38 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:58.041470 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e407c41-2705-47ef-a637-e5f16f50fa38 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:58.043059 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e407c41-2705-47ef-a637-e5f16f50fa38 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:58.174046 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9a81868c-8cb6-4924-bbe4-12e2696d6124 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:58.186885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9a81868c-8cb6-4924-bbe4-12e2696d6124 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.233889 Jun 21 08:15:58.189243 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 33/63] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:57 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:58.390191 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3bd0947f-0302-4c41-8e8a-edbc1bb6141f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:58.390850 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3bd0947f-0302-4c41-8e8a-edbc1bb6141f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:58.404186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3bd0947f-0302-4c41-8e8a-edbc1bb6141f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:58.404776 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3bd0947f-0302-4c41-8e8a-edbc1bb6141f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:58.405405 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3bd0947f-0302-4c41-8e8a-edbc1bb6141f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:58.406093 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3bd0947f-0302-4c41-8e8a-edbc1bb6141f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:58.453545 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4e407c41-2705-47ef-a637-e5f16f50fa38 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:58.463903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4e407c41-2705-47ef-a637-e5f16f50fa38 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.438390 Jun 21 08:15:58.467434 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 31/64] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:58 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:58.612005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-3bd0947f-0302-4c41-8e8a-edbc1bb6141f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:58.620360 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3bd0947f-0302-4c41-8e8a-edbc1bb6141f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.234851 Jun 21 08:15:58.631470 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 34/65] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:58 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:15:59.016608 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d0ec38bf-e061-4120-95e0-a7b3cc873570 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:59.017383 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d0ec38bf-e061-4120-95e0-a7b3cc873570 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:59.023332 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d0ec38bf-e061-4120-95e0-a7b3cc873570 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:59.023780 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d0ec38bf-e061-4120-95e0-a7b3cc873570 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:59.024537 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d0ec38bf-e061-4120-95e0-a7b3cc873570 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:59.024967 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d0ec38bf-e061-4120-95e0-a7b3cc873570 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:59.154015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d0ec38bf-e061-4120-95e0-a7b3cc873570 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:59.161869 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d0ec38bf-e061-4120-95e0-a7b3cc873570 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.149305 Jun 21 08:15:59.162463 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 32/66] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:59 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:59.205129 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9dba5e06-756a-4637-a4c8-64014c9cc9ad tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:59.205761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9dba5e06-756a-4637-a4c8-64014c9cc9ad tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:59.211782 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9dba5e06-756a-4637-a4c8-64014c9cc9ad tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:59.212227 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9dba5e06-756a-4637-a4c8-64014c9cc9ad tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:59.213002 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9dba5e06-756a-4637-a4c8-64014c9cc9ad tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:59.213431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9dba5e06-756a-4637-a4c8-64014c9cc9ad tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:59.352862 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9dba5e06-756a-4637-a4c8-64014c9cc9ad tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:59.360106 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9dba5e06-756a-4637-a4c8-64014c9cc9ad tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.158807 Jun 21 08:15:59.360664 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 35/67] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:59 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:59.484195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-978e0cee-0eec-439b-9b74-0aa8b1bb85d5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:59.484805 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-978e0cee-0eec-439b-9b74-0aa8b1bb85d5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:59.490943 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-978e0cee-0eec-439b-9b74-0aa8b1bb85d5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:59.491391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-978e0cee-0eec-439b-9b74-0aa8b1bb85d5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:59.492143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-978e0cee-0eec-439b-9b74-0aa8b1bb85d5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:59.492583 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-978e0cee-0eec-439b-9b74-0aa8b1bb85d5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:59.627110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-978e0cee-0eec-439b-9b74-0aa8b1bb85d5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:59.628930 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-978e0cee-0eec-439b-9b74-0aa8b1bb85d5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.148604 Jun 21 08:15:59.629520 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 33/68] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:59 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:59.643354 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c9bcff23-54b3-4e95-b5e7-782abbb201a5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:15:59.644535 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c9bcff23-54b3-4e95-b5e7-782abbb201a5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:15:59.652988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c9bcff23-54b3-4e95-b5e7-782abbb201a5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:59.653430 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c9bcff23-54b3-4e95-b5e7-782abbb201a5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:59.654188 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c9bcff23-54b3-4e95-b5e7-782abbb201a5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:15:59.654629 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c9bcff23-54b3-4e95-b5e7-782abbb201a5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:15:59.779345 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c9bcff23-54b3-4e95-b5e7-782abbb201a5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:15:59.787090 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c9bcff23-54b3-4e95-b5e7-782abbb201a5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.150440 Jun 21 08:15:59.787649 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 36/69] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:15:59 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:15:59.997713 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-7d1c38a2-406a-41a3-8786-2d357ff6c279 req-f02cdfc8-fba4-4c93-8ee7-de05d11e47aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a986f1a9-57eb-4763-9487-8312fb029ae9", "tag": "ce685fa0-a928-459e-a8b1-21743bcb9479"}, {"name": "network-changed", "server_uuid": "7a94231b-1d32-451c-87ec-0b8264564d27", "tag": "1cc80cea-1318-4662-be70-c38f26b1e312"}, {"name": "network-changed", "server_uuid": "dfb2c496-4e45-441d-839c-09445870d85e", "tag": "26d5d4da-35f8-4ab6-9617-7a5e462e84b3"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:00.005876 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:00.011248 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-7d1c38a2-406a-41a3-8786-2d357ff6c279 req-f02cdfc8-fba4-4c93-8ee7-de05d11e47aa service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.011687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-7d1c38a2-406a-41a3-8786-2d357ff6c279 req-f02cdfc8-fba4-4c93-8ee7-de05d11e47aa service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:00.033910 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-7d1c38a2-406a-41a3-8786-2d357ff6c279 req-f02cdfc8-fba4-4c93-8ee7-de05d11e47aa service nova] Creating event network-changed:ce685fa0-a928-459e-a8b1-21743bcb9479 for instance a986f1a9-57eb-4763-9487-8312fb029ae9 on hv-cinder-83697 Jun 21 08:16:00.034408 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-7d1c38a2-406a-41a3-8786-2d357ff6c279 req-f02cdfc8-fba4-4c93-8ee7-de05d11e47aa service nova] Creating event network-changed:1cc80cea-1318-4662-be70-c38f26b1e312 for instance 7a94231b-1d32-451c-87ec-0b8264564d27 on hv-cinder-83697 Jun 21 08:16:00.034939 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-7d1c38a2-406a-41a3-8786-2d357ff6c279 req-f02cdfc8-fba4-4c93-8ee7-de05d11e47aa service nova] Creating event network-changed:26d5d4da-35f8-4ab6-9617-7a5e462e84b3 for instance dfb2c496-4e45-441d-839c-09445870d85e on hv-cinder-83697 Jun 21 08:16:00.035478 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-7d1c38a2-406a-41a3-8786-2d357ff6c279 req-f02cdfc8-fba4-4c93-8ee7-de05d11e47aa service nova] Acquired lock "compute-rpcapi-router" {{(pid=117548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 08:16:00.036536 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fa794925-246a-4206-8005-e3ee940e3f18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.036966 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fa794925-246a-4206-8005-e3ee940e3f18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:00.037738 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fa794925-246a-4206-8005-e3ee940e3f18 None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.038165 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fa794925-246a-4206-8005-e3ee940e3f18 None None] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:00.046531 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.compute.rpcapi [None req-fa794925-246a-4206-8005-e3ee940e3f18 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 08:16:00.047406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fa794925-246a-4206-8005-e3ee940e3f18 None None] Releasing lock "compute-rpcapi-router" {{(pid=117548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 08:16:00.066362 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fa794925-246a-4206-8005-e3ee940e3f18 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.072190 Jun 21 08:16:00.067007 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 34/70] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:00.179880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-83374373-a8b8-43f9-87c5-5ab9ac927f06 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:00.180429 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-83374373-a8b8-43f9-87c5-5ab9ac927f06 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:00.186406 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-83374373-a8b8-43f9-87c5-5ab9ac927f06 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.186883 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-83374373-a8b8-43f9-87c5-5ab9ac927f06 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:00.187639 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-83374373-a8b8-43f9-87c5-5ab9ac927f06 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.188073 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-83374373-a8b8-43f9-87c5-5ab9ac927f06 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:00.321451 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-83374373-a8b8-43f9-87c5-5ab9ac927f06 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:00.329629 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-83374373-a8b8-43f9-87c5-5ab9ac927f06 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.153608 Jun 21 08:16:00.330186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 37/71] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:00 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:00.378260 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6782577e-7251-4c44-81d0-660c0a7c6dca tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:00.378985 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6782577e-7251-4c44-81d0-660c0a7c6dca tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:00.385368 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6782577e-7251-4c44-81d0-660c0a7c6dca tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.385820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6782577e-7251-4c44-81d0-660c0a7c6dca tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:00.386611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6782577e-7251-4c44-81d0-660c0a7c6dca tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.387067 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6782577e-7251-4c44-81d0-660c0a7c6dca tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:00.517918 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6782577e-7251-4c44-81d0-660c0a7c6dca tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:00.525487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6782577e-7251-4c44-81d0-660c0a7c6dca tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.152203 Jun 21 08:16:00.526027 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 35/72] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:00 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:00.645602 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-2be4db49-33e2-431a-afe9-eba1c9ba090b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:00.646211 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-2be4db49-33e2-431a-afe9-eba1c9ba090b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:00.652190 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2be4db49-33e2-431a-afe9-eba1c9ba090b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.652632 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2be4db49-33e2-431a-afe9-eba1c9ba090b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:00.653377 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2be4db49-33e2-431a-afe9-eba1c9ba090b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.653808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2be4db49-33e2-431a-afe9-eba1c9ba090b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:00.786076 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2be4db49-33e2-431a-afe9-eba1c9ba090b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:00.793731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-2be4db49-33e2-431a-afe9-eba1c9ba090b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.152014 Jun 21 08:16:00.794319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 38/73] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:00 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:00.803952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0575c0c4-8190-4650-886e-6196b934325b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:00.804569 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0575c0c4-8190-4650-886e-6196b934325b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:00.810891 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0575c0c4-8190-4650-886e-6196b934325b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.811338 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0575c0c4-8190-4650-886e-6196b934325b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:00.812102 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0575c0c4-8190-4650-886e-6196b934325b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:00.812533 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0575c0c4-8190-4650-886e-6196b934325b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:01.352559 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-91970746-5daa-4f07-95ff-da0123eaeedf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:01.353192 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-91970746-5daa-4f07-95ff-da0123eaeedf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:01.365887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=8 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:01.368369 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-91970746-5daa-4f07-95ff-da0123eaeedf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:01.374747 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-91970746-5daa-4f07-95ff-da0123eaeedf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:01.376067 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-91970746-5daa-4f07-95ff-da0123eaeedf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:01.378188 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-91970746-5daa-4f07-95ff-da0123eaeedf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:01.575566 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-91970746-5daa-4f07-95ff-da0123eaeedf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:01.585034 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-91970746-5daa-4f07-95ff-da0123eaeedf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.241747 Jun 21 08:16:01.585621 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 39/74] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:01 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:01.599650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-478b207e-76f6-4f5e-b20d-0ffc816d1536 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:01.600399 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-478b207e-76f6-4f5e-b20d-0ffc816d1536 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:01.607058 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-478b207e-76f6-4f5e-b20d-0ffc816d1536 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:01.607605 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-478b207e-76f6-4f5e-b20d-0ffc816d1536 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:01.608451 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-478b207e-76f6-4f5e-b20d-0ffc816d1536 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:01.608952 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-478b207e-76f6-4f5e-b20d-0ffc816d1536 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:01.677432 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0575c0c4-8190-4650-886e-6196b934325b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:01.694070 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0575c0c4-8190-4650-886e-6196b934325b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.892062 Jun 21 08:16:01.696025 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 36/75] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:00 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:01.792683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-478b207e-76f6-4f5e-b20d-0ffc816d1536 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:01.802440 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-478b207e-76f6-4f5e-b20d-0ffc816d1536 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.215552 Jun 21 08:16:01.803537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 40/76] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:01 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:01.809793 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ab15ac31-9d30-4747-a272-77537c9fa45b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:01.810411 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-ab15ac31-9d30-4747-a272-77537c9fa45b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:01.818051 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ab15ac31-9d30-4747-a272-77537c9fa45b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:01.818512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ab15ac31-9d30-4747-a272-77537c9fa45b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:01.819325 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ab15ac31-9d30-4747-a272-77537c9fa45b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:01.819757 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ab15ac31-9d30-4747-a272-77537c9fa45b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:02.224961 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-ab15ac31-9d30-4747-a272-77537c9fa45b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:02.240835 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ab15ac31-9d30-4747-a272-77537c9fa45b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.434730 Jun 21 08:16:02.254279 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 37/77] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:01 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:02.601249 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-81d580f4-49aa-42a7-b229-0bde4951aa55 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:02.601897 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-81d580f4-49aa-42a7-b229-0bde4951aa55 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:02.617435 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81d580f4-49aa-42a7-b229-0bde4951aa55 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:02.618315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81d580f4-49aa-42a7-b229-0bde4951aa55 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:02.619356 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81d580f4-49aa-42a7-b229-0bde4951aa55 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:02.619988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81d580f4-49aa-42a7-b229-0bde4951aa55 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:02.713289 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5b219b47-6eed-40c4-b869-0cdf7ae26b51 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:02.713916 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5b219b47-6eed-40c4-b869-0cdf7ae26b51 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:02.723733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5b219b47-6eed-40c4-b869-0cdf7ae26b51 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:02.724185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5b219b47-6eed-40c4-b869-0cdf7ae26b51 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:02.725109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5b219b47-6eed-40c4-b869-0cdf7ae26b51 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:02.725543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5b219b47-6eed-40c4-b869-0cdf7ae26b51 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:02.854322 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-81d580f4-49aa-42a7-b229-0bde4951aa55 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:02.864189 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-81d580f4-49aa-42a7-b229-0bde4951aa55 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.266681 Jun 21 08:16:02.865397 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 41/78] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:02 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:02.878499 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-17d23c81-a1b2-4bc9-b320-e0d489336ab2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:02.879222 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-17d23c81-a1b2-4bc9-b320-e0d489336ab2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:02.886390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17d23c81-a1b2-4bc9-b320-e0d489336ab2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:02.886928 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17d23c81-a1b2-4bc9-b320-e0d489336ab2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:02.887814 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17d23c81-a1b2-4bc9-b320-e0d489336ab2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:02.888256 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17d23c81-a1b2-4bc9-b320-e0d489336ab2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:02.909704 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5b219b47-6eed-40c4-b869-0cdf7ae26b51 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:02.919158 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5b219b47-6eed-40c4-b869-0cdf7ae26b51 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.209524 Jun 21 08:16:02.919863 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 38/79] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:02 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:03.028319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-17d23c81-a1b2-4bc9-b320-e0d489336ab2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:03.036373 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-17d23c81-a1b2-4bc9-b320-e0d489336ab2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.169716 Jun 21 08:16:03.042876 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 42/80] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:02 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:03.260903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c81d7850-a797-4377-8a7f-673f3b7f5bdc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:03.261603 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c81d7850-a797-4377-8a7f-673f3b7f5bdc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:03.268189 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c81d7850-a797-4377-8a7f-673f3b7f5bdc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:03.268645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c81d7850-a797-4377-8a7f-673f3b7f5bdc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:03.269397 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c81d7850-a797-4377-8a7f-673f3b7f5bdc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:03.269846 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c81d7850-a797-4377-8a7f-673f3b7f5bdc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:03.445075 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c81d7850-a797-4377-8a7f-673f3b7f5bdc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:03.452694 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c81d7850-a797-4377-8a7f-673f3b7f5bdc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.195703 Jun 21 08:16:03.453256 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 39/81] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:03 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:03.881213 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-448f2f16-fedb-4aad-af94-77c4ad038190 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:03.881923 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-448f2f16-fedb-4aad-af94-77c4ad038190 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:03.887903 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-448f2f16-fedb-4aad-af94-77c4ad038190 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:03.888346 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-448f2f16-fedb-4aad-af94-77c4ad038190 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:03.889095 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-448f2f16-fedb-4aad-af94-77c4ad038190 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:03.889522 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-448f2f16-fedb-4aad-af94-77c4ad038190 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:03.936656 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ac3bc82f-10d3-417a-9a83-4ea381dcf6f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:03.937277 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-ac3bc82f-10d3-417a-9a83-4ea381dcf6f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:03.944079 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ac3bc82f-10d3-417a-9a83-4ea381dcf6f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:03.944530 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ac3bc82f-10d3-417a-9a83-4ea381dcf6f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:03.945296 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ac3bc82f-10d3-417a-9a83-4ea381dcf6f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:03.945732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ac3bc82f-10d3-417a-9a83-4ea381dcf6f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:04.037404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-448f2f16-fedb-4aad-af94-77c4ad038190 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:04.051759 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-448f2f16-fedb-4aad-af94-77c4ad038190 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.174399 Jun 21 08:16:04.052348 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 43/82] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:03 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:04.060786 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-20a322e1-d221-4080-bdc3-88e1862550a3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:04.061770 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-20a322e1-d221-4080-bdc3-88e1862550a3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:04.069603 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-20a322e1-d221-4080-bdc3-88e1862550a3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:04.070366 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-20a322e1-d221-4080-bdc3-88e1862550a3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:04.071185 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-20a322e1-d221-4080-bdc3-88e1862550a3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:04.071623 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-20a322e1-d221-4080-bdc3-88e1862550a3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:04.119474 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-ac3bc82f-10d3-417a-9a83-4ea381dcf6f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:04.132571 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ac3bc82f-10d3-417a-9a83-4ea381dcf6f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.199516 Jun 21 08:16:04.133536 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 40/83] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:03 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:04.208788 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-20a322e1-d221-4080-bdc3-88e1862550a3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:04.217378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-20a322e1-d221-4080-bdc3-88e1862550a3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.163504 Jun 21 08:16:04.218131 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 44/84] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:04 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:04.470792 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-19ca338b-9851-40dc-916a-56dcbc2fc6d0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:04.471844 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-19ca338b-9851-40dc-916a-56dcbc2fc6d0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:04.478314 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19ca338b-9851-40dc-916a-56dcbc2fc6d0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:04.478791 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19ca338b-9851-40dc-916a-56dcbc2fc6d0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:04.479562 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19ca338b-9851-40dc-916a-56dcbc2fc6d0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:04.479992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19ca338b-9851-40dc-916a-56dcbc2fc6d0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:04.635110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-19ca338b-9851-40dc-916a-56dcbc2fc6d0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:04.643360 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-19ca338b-9851-40dc-916a-56dcbc2fc6d0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.177212 Jun 21 08:16:04.644069 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 41/85] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:04 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:05.070684 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e7571233-5941-4f9d-9c18-61443738b164 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:05.071318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e7571233-5941-4f9d-9c18-61443738b164 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:05.078245 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7571233-5941-4f9d-9c18-61443738b164 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:05.078814 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7571233-5941-4f9d-9c18-61443738b164 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:05.080171 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7571233-5941-4f9d-9c18-61443738b164 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:05.080690 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7571233-5941-4f9d-9c18-61443738b164 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:05.091511 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:05.150724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-43da5a79-f68c-4218-9a80-7b3d3cbb1a84 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:05.151274 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-43da5a79-f68c-4218-9a80-7b3d3cbb1a84 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:05.157206 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-43da5a79-f68c-4218-9a80-7b3d3cbb1a84 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:05.157682 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-43da5a79-f68c-4218-9a80-7b3d3cbb1a84 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:05.159016 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-43da5a79-f68c-4218-9a80-7b3d3cbb1a84 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:05.159455 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-43da5a79-f68c-4218-9a80-7b3d3cbb1a84 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:05.233187 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e7571233-5941-4f9d-9c18-61443738b164 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:05.241013 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e7571233-5941-4f9d-9c18-61443738b164 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.174751 Jun 21 08:16:05.241210 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 45/86] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:05 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:05.248624 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ce453808-94d7-4ce2-96ff-75d4673034c5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:05.249558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ce453808-94d7-4ce2-96ff-75d4673034c5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:05.256557 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ce453808-94d7-4ce2-96ff-75d4673034c5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:05.257004 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ce453808-94d7-4ce2-96ff-75d4673034c5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:05.257762 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ce453808-94d7-4ce2-96ff-75d4673034c5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:05.258192 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ce453808-94d7-4ce2-96ff-75d4673034c5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:05.293609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-43da5a79-f68c-4218-9a80-7b3d3cbb1a84 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:05.301893 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-43da5a79-f68c-4218-9a80-7b3d3cbb1a84 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.155183 Jun 21 08:16:05.302469 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 42/87] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:05 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:05.391153 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ce453808-94d7-4ce2-96ff-75d4673034c5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:05.399664 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ce453808-94d7-4ce2-96ff-75d4673034c5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.157314 Jun 21 08:16:05.400242 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 46/88] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:05 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:05.672919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5ebb0cff-2886-4d05-bc5c-c0d5818e22f4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:05.674798 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5ebb0cff-2886-4d05-bc5c-c0d5818e22f4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:05.683861 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5ebb0cff-2886-4d05-bc5c-c0d5818e22f4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:05.684632 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5ebb0cff-2886-4d05-bc5c-c0d5818e22f4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:05.685623 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5ebb0cff-2886-4d05-bc5c-c0d5818e22f4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:05.686495 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5ebb0cff-2886-4d05-bc5c-c0d5818e22f4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:05.860849 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5ebb0cff-2886-4d05-bc5c-c0d5818e22f4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:05.870372 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5ebb0cff-2886-4d05-bc5c-c0d5818e22f4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.213857 Jun 21 08:16:05.884320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 43/89] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:05 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:06.074362 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-f1ddc33f-2805-477b-b02e-2c07d362dada req-f6e15091-515d-4f52-ad9a-ab08f8a24a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe8e00a-97d1-4e7c-8a02-db6a981670fc", "name": "network-vif-plugged", "status": "completed", "tag": "401a4b2e-926f-405f-af0e-bb07243e04fc"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:06.084194 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-f1ddc33f-2805-477b-b02e-2c07d362dada req-f6e15091-515d-4f52-ad9a-ab08f8a24a56 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:06.084608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-f1ddc33f-2805-477b-b02e-2c07d362dada req-f6e15091-515d-4f52-ad9a-ab08f8a24a56 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:06.101478 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-f1ddc33f-2805-477b-b02e-2c07d362dada req-f6e15091-515d-4f52-ad9a-ab08f8a24a56 service nova] Creating event network-vif-plugged:401a4b2e-926f-405f-af0e-bb07243e04fc for instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc on hv-cinder-83697 Jun 21 08:16:06.108110 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-f1ddc33f-2805-477b-b02e-2c07d362dada req-f6e15091-515d-4f52-ad9a-ab08f8a24a56 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107121 Jun 21 08:16:06.109188 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 47/90] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:06.257852 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a4f536ac-f8fa-4ce5-811f-431427c7f537 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:06.258373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a4f536ac-f8fa-4ce5-811f-431427c7f537 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:06.271514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a4f536ac-f8fa-4ce5-811f-431427c7f537 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:06.272230 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a4f536ac-f8fa-4ce5-811f-431427c7f537 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:06.273015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a4f536ac-f8fa-4ce5-811f-431427c7f537 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:06.273454 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a4f536ac-f8fa-4ce5-811f-431427c7f537 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:06.320976 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-082976e5-b0fc-4e52-9939-29786e23d1ab tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:06.321885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-082976e5-b0fc-4e52-9939-29786e23d1ab tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:06.329533 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-082976e5-b0fc-4e52-9939-29786e23d1ab tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:06.330567 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-082976e5-b0fc-4e52-9939-29786e23d1ab tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:06.331726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-082976e5-b0fc-4e52-9939-29786e23d1ab tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:06.332317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-082976e5-b0fc-4e52-9939-29786e23d1ab tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:06.544432 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-082976e5-b0fc-4e52-9939-29786e23d1ab tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:06.552973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-082976e5-b0fc-4e52-9939-29786e23d1ab tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.236484 Jun 21 08:16:06.553613 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 48/91] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:06 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:06.558252 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-62136f1c-e72b-4141-be7e-ac4500ae9fb1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:06.559188 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-62136f1c-e72b-4141-be7e-ac4500ae9fb1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:06.565649 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-62136f1c-e72b-4141-be7e-ac4500ae9fb1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:06.566177 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-62136f1c-e72b-4141-be7e-ac4500ae9fb1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:06.567081 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-62136f1c-e72b-4141-be7e-ac4500ae9fb1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:06.567769 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-62136f1c-e72b-4141-be7e-ac4500ae9fb1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:06.692353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a4f536ac-f8fa-4ce5-811f-431427c7f537 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:06.698079 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a4f536ac-f8fa-4ce5-811f-431427c7f537 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.444004 Jun 21 08:16:06.698677 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 44/92] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:06 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:06.779492 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-62136f1c-e72b-4141-be7e-ac4500ae9fb1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:06.791000 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-62136f1c-e72b-4141-be7e-ac4500ae9fb1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.236132 Jun 21 08:16:06.791579 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 49/93] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:06 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:06.887935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6a825f25-165e-4e2a-85ea-b1996fca8047 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:06.888607 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6a825f25-165e-4e2a-85ea-b1996fca8047 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:06.896697 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6a825f25-165e-4e2a-85ea-b1996fca8047 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:06.897207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6a825f25-165e-4e2a-85ea-b1996fca8047 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:06.897935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6a825f25-165e-4e2a-85ea-b1996fca8047 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:06.898337 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6a825f25-165e-4e2a-85ea-b1996fca8047 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:07.033387 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6a825f25-165e-4e2a-85ea-b1996fca8047 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:07.036942 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=100 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:07.041943 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6a825f25-165e-4e2a-85ea-b1996fca8047 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.158103 Jun 21 08:16:07.042524 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 45/94] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:06 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:07.571933 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9471b50f-81e3-4f9f-9530-cefd65f39d8c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:07.573114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9471b50f-81e3-4f9f-9530-cefd65f39d8c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:07.580615 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9471b50f-81e3-4f9f-9530-cefd65f39d8c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:07.581134 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9471b50f-81e3-4f9f-9530-cefd65f39d8c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:07.582316 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9471b50f-81e3-4f9f-9530-cefd65f39d8c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:07.582794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9471b50f-81e3-4f9f-9530-cefd65f39d8c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:07.715931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-30be6d4e-aa15-452d-bd28-6c2632464abc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:07.716553 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-30be6d4e-aa15-452d-bd28-6c2632464abc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:07.723931 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9471b50f-81e3-4f9f-9530-cefd65f39d8c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:07.725653 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-30be6d4e-aa15-452d-bd28-6c2632464abc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:07.726207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-30be6d4e-aa15-452d-bd28-6c2632464abc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:07.727677 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-30be6d4e-aa15-452d-bd28-6c2632464abc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:07.728187 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-30be6d4e-aa15-452d-bd28-6c2632464abc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:07.731168 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9471b50f-81e3-4f9f-9530-cefd65f39d8c tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.164836 Jun 21 08:16:07.735456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 50/95] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:07 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:07.811482 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dd5d06c3-b770-415e-aa7d-13cddc2cda03 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:07.812098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-dd5d06c3-b770-415e-aa7d-13cddc2cda03 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:07.819711 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd5d06c3-b770-415e-aa7d-13cddc2cda03 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:07.820462 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd5d06c3-b770-415e-aa7d-13cddc2cda03 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:07.822405 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd5d06c3-b770-415e-aa7d-13cddc2cda03 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:07.823019 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd5d06c3-b770-415e-aa7d-13cddc2cda03 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:07.910162 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-30be6d4e-aa15-452d-bd28-6c2632464abc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:07.919623 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-30be6d4e-aa15-452d-bd28-6c2632464abc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.207593 Jun 21 08:16:07.920200 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 46/96] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:07 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:07.997252 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-dd5d06c3-b770-415e-aa7d-13cddc2cda03 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:08.006294 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-dd5d06c3-b770-415e-aa7d-13cddc2cda03 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.198454 Jun 21 08:16:08.007250 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 51/97] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:07 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:08.059144 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3fda8ff4-0cdc-4dd5-bc4d-9df6456970ba tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:08.060006 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3fda8ff4-0cdc-4dd5-bc4d-9df6456970ba tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:08.067118 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fda8ff4-0cdc-4dd5-bc4d-9df6456970ba tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:08.068440 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fda8ff4-0cdc-4dd5-bc4d-9df6456970ba tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:08.069436 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fda8ff4-0cdc-4dd5-bc4d-9df6456970ba tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:08.070082 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fda8ff4-0cdc-4dd5-bc4d-9df6456970ba tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:08.209178 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3fda8ff4-0cdc-4dd5-bc4d-9df6456970ba tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:08.226282 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3fda8ff4-0cdc-4dd5-bc4d-9df6456970ba tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.170807 Jun 21 08:16:08.228694 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 47/98] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:08 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:08.750022 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1732f968-bd53-4885-8e11-ce404b4c42f3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:08.750847 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1732f968-bd53-4885-8e11-ce404b4c42f3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:08.758345 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1732f968-bd53-4885-8e11-ce404b4c42f3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:08.758826 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1732f968-bd53-4885-8e11-ce404b4c42f3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:08.759677 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1732f968-bd53-4885-8e11-ce404b4c42f3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:08.760114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1732f968-bd53-4885-8e11-ce404b4c42f3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:08.943753 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-966f48d0-0bbf-470c-aa3f-94ccb9bba62b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:08.944609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-966f48d0-0bbf-470c-aa3f-94ccb9bba62b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:08.949985 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1732f968-bd53-4885-8e11-ce404b4c42f3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:08.953464 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-966f48d0-0bbf-470c-aa3f-94ccb9bba62b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:08.954065 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-966f48d0-0bbf-470c-aa3f-94ccb9bba62b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:08.955827 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-966f48d0-0bbf-470c-aa3f-94ccb9bba62b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:08.956516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-966f48d0-0bbf-470c-aa3f-94ccb9bba62b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:08.960074 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1732f968-bd53-4885-8e11-ce404b4c42f3 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.214653 Jun 21 08:16:08.969824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 52/99] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:08 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:09.029591 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-946f388f-dd39-4469-bf93-7eef5e9b8c2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:09.030677 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-946f388f-dd39-4469-bf93-7eef5e9b8c2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:09.037185 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-946f388f-dd39-4469-bf93-7eef5e9b8c2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:09.037910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-946f388f-dd39-4469-bf93-7eef5e9b8c2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:09.039029 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-946f388f-dd39-4469-bf93-7eef5e9b8c2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:09.039685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-946f388f-dd39-4469-bf93-7eef5e9b8c2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:09.155584 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-966f48d0-0bbf-470c-aa3f-94ccb9bba62b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:09.170312 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-966f48d0-0bbf-470c-aa3f-94ccb9bba62b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.236363 Jun 21 08:16:09.180812 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 48/100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:08 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:09.218849 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-946f388f-dd39-4469-bf93-7eef5e9b8c2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:09.227804 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-946f388f-dd39-4469-bf93-7eef5e9b8c2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.207743 Jun 21 08:16:09.229055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 53/101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:09 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:09.247021 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bea80d4b-86bf-42e4-98b0-e1140434a7d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:09.247647 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bea80d4b-86bf-42e4-98b0-e1140434a7d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:09.256778 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bea80d4b-86bf-42e4-98b0-e1140434a7d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:09.256778 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bea80d4b-86bf-42e4-98b0-e1140434a7d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:09.257356 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bea80d4b-86bf-42e4-98b0-e1140434a7d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:09.257775 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bea80d4b-86bf-42e4-98b0-e1140434a7d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:09.625073 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bea80d4b-86bf-42e4-98b0-e1140434a7d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:09.636981 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bea80d4b-86bf-42e4-98b0-e1140434a7d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.395626 Jun 21 08:16:09.638512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 49/102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:09 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:09.977030 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d5fe8cbf-f711-4b1e-8a6a-41c14bc825ca tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:09.978366 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d5fe8cbf-f711-4b1e-8a6a-41c14bc825ca tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:09.985308 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d5fe8cbf-f711-4b1e-8a6a-41c14bc825ca tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:09.986855 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d5fe8cbf-f711-4b1e-8a6a-41c14bc825ca tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:09.987983 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d5fe8cbf-f711-4b1e-8a6a-41c14bc825ca tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:09.988476 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d5fe8cbf-f711-4b1e-8a6a-41c14bc825ca tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:10.187548 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:10.192081 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d5fe8cbf-f711-4b1e-8a6a-41c14bc825ca tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:10.193578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-209c911e-70e5-4f25-afe5-f3310f5f46d9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:10.194332 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-209c911e-70e5-4f25-afe5-f3310f5f46d9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:10.208141 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-209c911e-70e5-4f25-afe5-f3310f5f46d9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:10.208551 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d5fe8cbf-f711-4b1e-8a6a-41c14bc825ca tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.234816 Jun 21 08:16:10.208672 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-209c911e-70e5-4f25-afe5-f3310f5f46d9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:10.209344 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-209c911e-70e5-4f25-afe5-f3310f5f46d9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:10.209648 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 54/103] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:09 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:10.209764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-209c911e-70e5-4f25-afe5-f3310f5f46d9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:10.246016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-48eda916-e693-4b45-b8c6-5ca45207603e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:10.246980 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-48eda916-e693-4b45-b8c6-5ca45207603e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:10.257973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-48eda916-e693-4b45-b8c6-5ca45207603e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:10.259892 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-48eda916-e693-4b45-b8c6-5ca45207603e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:10.262210 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-48eda916-e693-4b45-b8c6-5ca45207603e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:10.262772 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-48eda916-e693-4b45-b8c6-5ca45207603e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:10.500881 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-48eda916-e693-4b45-b8c6-5ca45207603e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:10.510963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-48eda916-e693-4b45-b8c6-5ca45207603e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.269120 Jun 21 08:16:10.511788 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 55/104] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:10 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:10.563074 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-209c911e-70e5-4f25-afe5-f3310f5f46d9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:10.571299 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-209c911e-70e5-4f25-afe5-f3310f5f46d9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.386528 Jun 21 08:16:10.572304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 50/105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:10 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:10.655900 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1c94462c-aef1-4d60-9b55-451ef75a3c5f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:10.657336 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1c94462c-aef1-4d60-9b55-451ef75a3c5f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:10.667046 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1c94462c-aef1-4d60-9b55-451ef75a3c5f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:10.667652 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1c94462c-aef1-4d60-9b55-451ef75a3c5f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:10.668752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1c94462c-aef1-4d60-9b55-451ef75a3c5f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:10.669335 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1c94462c-aef1-4d60-9b55-451ef75a3c5f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:10.865629 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1c94462c-aef1-4d60-9b55-451ef75a3c5f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:10.879830 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1c94462c-aef1-4d60-9b55-451ef75a3c5f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.228833 Jun 21 08:16:10.880483 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 56/106] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:10 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:11.227464 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d5f93c2a-fc0c-4886-8c9f-ded038deed4b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:11.228673 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d5f93c2a-fc0c-4886-8c9f-ded038deed4b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:11.235386 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d5f93c2a-fc0c-4886-8c9f-ded038deed4b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:11.236168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d5f93c2a-fc0c-4886-8c9f-ded038deed4b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:11.237066 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d5f93c2a-fc0c-4886-8c9f-ded038deed4b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:11.237503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d5f93c2a-fc0c-4886-8c9f-ded038deed4b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:11.530254 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8619e1c7-a4f3-4bd8-a649-3e3c25bffeeb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:11.531997 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8619e1c7-a4f3-4bd8-a649-3e3c25bffeeb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:11.541951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8619e1c7-a4f3-4bd8-a649-3e3c25bffeeb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:11.542601 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8619e1c7-a4f3-4bd8-a649-3e3c25bffeeb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:11.543806 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8619e1c7-a4f3-4bd8-a649-3e3c25bffeeb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:11.544452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8619e1c7-a4f3-4bd8-a649-3e3c25bffeeb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:11.762261 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d5f93c2a-fc0c-4886-8c9f-ded038deed4b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:11.774789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d5f93c2a-fc0c-4886-8c9f-ded038deed4b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.550970 Jun 21 08:16:11.778257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 51/107] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:11 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:11.787445 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-88350189-d73e-463e-bebf-54de96c34006 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:11.788069 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-88350189-d73e-463e-bebf-54de96c34006 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:11.788466 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8619e1c7-a4f3-4bd8-a649-3e3c25bffeeb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:11.800934 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8619e1c7-a4f3-4bd8-a649-3e3c25bffeeb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.276593 Jun 21 08:16:11.801822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 57/108] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:11 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:11.806315 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88350189-d73e-463e-bebf-54de96c34006 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:11.806801 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88350189-d73e-463e-bebf-54de96c34006 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:11.807593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88350189-d73e-463e-bebf-54de96c34006 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:11.808006 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88350189-d73e-463e-bebf-54de96c34006 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:11.898924 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ae545843-7992-4479-bd9c-e82a7bd03ca9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:11.899475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ae545843-7992-4479-bd9c-e82a7bd03ca9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:11.908611 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae545843-7992-4479-bd9c-e82a7bd03ca9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:11.909180 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae545843-7992-4479-bd9c-e82a7bd03ca9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:11.910130 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae545843-7992-4479-bd9c-e82a7bd03ca9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:11.910651 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae545843-7992-4479-bd9c-e82a7bd03ca9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:12.144585 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ae545843-7992-4479-bd9c-e82a7bd03ca9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:12.177588 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ae545843-7992-4479-bd9c-e82a7bd03ca9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.269641 Jun 21 08:16:12.180841 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 58/109] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:11 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:12.200174 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-eed9d88b-a3a5-4bb3-975e-8a4bd558f034 req-9bb4dc6d-9cb0-485b-bc62-3d19f1598de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c08d704-c754-4c7d-b0f4-540ebde6c782", "name": "network-vif-plugged", "status": "completed", "tag": "e7af3654-e669-4deb-a185-42a54ed5e149"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:12.243123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-eed9d88b-a3a5-4bb3-975e-8a4bd558f034 req-9bb4dc6d-9cb0-485b-bc62-3d19f1598de8 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:12.244783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-eed9d88b-a3a5-4bb3-975e-8a4bd558f034 req-9bb4dc6d-9cb0-485b-bc62-3d19f1598de8 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:12.259179 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-88350189-d73e-463e-bebf-54de96c34006 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:12.271102 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-88350189-d73e-463e-bebf-54de96c34006 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.491286 Jun 21 08:16:12.272180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 52/110] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:11 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:12.282528 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-eed9d88b-a3a5-4bb3-975e-8a4bd558f034 req-9bb4dc6d-9cb0-485b-bc62-3d19f1598de8 service nova] Creating event network-vif-plugged:e7af3654-e669-4deb-a185-42a54ed5e149 for instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 on hv-cinder-83697 Jun 21 08:16:12.286281 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-eed9d88b-a3a5-4bb3-975e-8a4bd558f034 req-9bb4dc6d-9cb0-485b-bc62-3d19f1598de8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103925 Jun 21 08:16:12.287581 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 59/111] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:12.796239 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-83fc47d6-339f-496a-9e6e-bf02433fa82e tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:12.796851 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-83fc47d6-339f-496a-9e6e-bf02433fa82e tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:12.806169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-83fc47d6-339f-496a-9e6e-bf02433fa82e tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:12.808012 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-83fc47d6-339f-496a-9e6e-bf02433fa82e tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:12.808838 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-83fc47d6-339f-496a-9e6e-bf02433fa82e tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:12.809243 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-83fc47d6-339f-496a-9e6e-bf02433fa82e tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:12.821191 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8e911eeb-829d-40ca-a8d0-031b40a738ac tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:12.823097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8e911eeb-829d-40ca-a8d0-031b40a738ac tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:12.831713 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8e911eeb-829d-40ca-a8d0-031b40a738ac tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:12.832374 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8e911eeb-829d-40ca-a8d0-031b40a738ac tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:12.833491 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8e911eeb-829d-40ca-a8d0-031b40a738ac tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:12.834160 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8e911eeb-829d-40ca-a8d0-031b40a738ac tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:12.981954 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-83fc47d6-339f-496a-9e6e-bf02433fa82e tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:12.991156 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-83fc47d6-339f-496a-9e6e-bf02433fa82e tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.200072 Jun 21 08:16:12.992232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 53/112] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:12 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:13.012278 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8e911eeb-829d-40ca-a8d0-031b40a738ac tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:13.021827 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8e911eeb-829d-40ca-a8d0-031b40a738ac tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.207699 Jun 21 08:16:13.024276 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 60/113] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:12 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:13.195565 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ab791924-bd42-427e-891b-c49c519a0ef6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:13.196098 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-ab791924-bd42-427e-891b-c49c519a0ef6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:13.202867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ab791924-bd42-427e-891b-c49c519a0ef6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:13.203312 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ab791924-bd42-427e-891b-c49c519a0ef6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:13.204376 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ab791924-bd42-427e-891b-c49c519a0ef6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:13.204767 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ab791924-bd42-427e-891b-c49c519a0ef6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:13.292629 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-61aad671-18ae-4745-9d89-fbe304948d57 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:13.293646 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-61aad671-18ae-4745-9d89-fbe304948d57 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:13.303032 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-61aad671-18ae-4745-9d89-fbe304948d57 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:13.303468 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-61aad671-18ae-4745-9d89-fbe304948d57 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:13.308280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-61aad671-18ae-4745-9d89-fbe304948d57 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:13.309238 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-61aad671-18ae-4745-9d89-fbe304948d57 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:13.388243 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-ab791924-bd42-427e-891b-c49c519a0ef6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:13.397596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ab791924-bd42-427e-891b-c49c519a0ef6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.205941 Jun 21 08:16:13.404077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 54/114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:13 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:13.474579 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-61aad671-18ae-4745-9d89-fbe304948d57 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:13.484379 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-61aad671-18ae-4745-9d89-fbe304948d57 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.196556 Jun 21 08:16:13.486665 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 61/115] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:13 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:14.010967 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-187809a4-53cb-4407-8b72-ee21178fe2fc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:14.012423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-187809a4-53cb-4407-8b72-ee21178fe2fc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:14.020813 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-187809a4-53cb-4407-8b72-ee21178fe2fc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:14.021545 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-187809a4-53cb-4407-8b72-ee21178fe2fc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:14.022482 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-187809a4-53cb-4407-8b72-ee21178fe2fc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:14.023170 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-187809a4-53cb-4407-8b72-ee21178fe2fc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:14.042317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3fcc37d2-4694-458b-8403-63d60773ea54 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:14.042992 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3fcc37d2-4694-458b-8403-63d60773ea54 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:14.052768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3fcc37d2-4694-458b-8403-63d60773ea54 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:14.053602 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3fcc37d2-4694-458b-8403-63d60773ea54 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:14.056704 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3fcc37d2-4694-458b-8403-63d60773ea54 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:14.057217 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3fcc37d2-4694-458b-8403-63d60773ea54 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:14.206659 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-187809a4-53cb-4407-8b72-ee21178fe2fc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:14.224513 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-187809a4-53cb-4407-8b72-ee21178fe2fc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.217639 Jun 21 08:16:14.225788 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 55/116] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:14 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:14.284417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-3fcc37d2-4694-458b-8403-63d60773ea54 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:14.295015 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3fcc37d2-4694-458b-8403-63d60773ea54 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.259391 Jun 21 08:16:14.304822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 62/117] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:14 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:14.339773 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-b16eb6c1-3252-4210-bd39-5d097567cb4b req-d99b0369-5974-47e0-bd1c-b11ae59f1028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a986f1a9-57eb-4763-9487-8312fb029ae9", "name": "network-vif-plugged", "status": "completed", "tag": "ce685fa0-a928-459e-a8b1-21743bcb9479"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:14.348418 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-b16eb6c1-3252-4210-bd39-5d097567cb4b req-d99b0369-5974-47e0-bd1c-b11ae59f1028 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:14.348861 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-b16eb6c1-3252-4210-bd39-5d097567cb4b req-d99b0369-5974-47e0-bd1c-b11ae59f1028 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:14.361593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-b16eb6c1-3252-4210-bd39-5d097567cb4b req-d99b0369-5974-47e0-bd1c-b11ae59f1028 service nova] Creating event network-vif-plugged:ce685fa0-a928-459e-a8b1-21743bcb9479 for instance a986f1a9-57eb-4763-9487-8312fb029ae9 on hv-cinder-83697 Jun 21 08:16:14.367688 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-b16eb6c1-3252-4210-bd39-5d097567cb4b req-d99b0369-5974-47e0-bd1c-b11ae59f1028 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032493 Jun 21 08:16:14.368288 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 56/118] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:16:14.415671 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-bf7be07a-dcab-401a-89b4-05c89d1d7957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:14.416304 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-bf7be07a-dcab-401a-89b4-05c89d1d7957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:14.433933 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bf7be07a-dcab-401a-89b4-05c89d1d7957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:14.435724 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bf7be07a-dcab-401a-89b4-05c89d1d7957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:14.436749 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bf7be07a-dcab-401a-89b4-05c89d1d7957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:14.440285 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bf7be07a-dcab-401a-89b4-05c89d1d7957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:14.450087 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:14.503355 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-901ca272-eb78-4e2e-8d2e-53619d63caee tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:14.504081 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-901ca272-eb78-4e2e-8d2e-53619d63caee tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:14.514279 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-901ca272-eb78-4e2e-8d2e-53619d63caee tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:14.514777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-901ca272-eb78-4e2e-8d2e-53619d63caee tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:14.515623 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-901ca272-eb78-4e2e-8d2e-53619d63caee tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:14.517979 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-901ca272-eb78-4e2e-8d2e-53619d63caee tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:14.695313 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-901ca272-eb78-4e2e-8d2e-53619d63caee tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:14.708028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-901ca272-eb78-4e2e-8d2e-53619d63caee tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.210048 Jun 21 08:16:14.709088 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 57/119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:14 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:14.741465 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-bf7be07a-dcab-401a-89b4-05c89d1d7957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:14.749291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-bf7be07a-dcab-401a-89b4-05c89d1d7957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.337469 Jun 21 08:16:14.750196 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 63/120] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:14 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:15.242096 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-35327be3-ca31-43c4-a9d8-04414fc06934 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:15.242883 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-35327be3-ca31-43c4-a9d8-04414fc06934 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:15.249606 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-35327be3-ca31-43c4-a9d8-04414fc06934 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:15.250239 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-35327be3-ca31-43c4-a9d8-04414fc06934 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:15.251402 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-35327be3-ca31-43c4-a9d8-04414fc06934 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:15.251835 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-35327be3-ca31-43c4-a9d8-04414fc06934 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:15.312558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-72e0958d-91dd-4a6d-ac64-237bcb0bdf20 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:15.313455 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-72e0958d-91dd-4a6d-ac64-237bcb0bdf20 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:15.321120 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-72e0958d-91dd-4a6d-ac64-237bcb0bdf20 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:15.323742 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-72e0958d-91dd-4a6d-ac64-237bcb0bdf20 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:15.325712 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-72e0958d-91dd-4a6d-ac64-237bcb0bdf20 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:15.329100 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-72e0958d-91dd-4a6d-ac64-237bcb0bdf20 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:15.459015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-35327be3-ca31-43c4-a9d8-04414fc06934 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:15.467088 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-35327be3-ca31-43c4-a9d8-04414fc06934 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.229132 Jun 21 08:16:15.467575 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 58/121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:15 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:15.523584 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-72e0958d-91dd-4a6d-ac64-237bcb0bdf20 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:15.532001 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-72e0958d-91dd-4a6d-ac64-237bcb0bdf20 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.223354 Jun 21 08:16:15.533340 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 64/122] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:15 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:15.725147 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-48647088-30b6-4178-b2d5-5032d861a3bf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:15.725766 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-48647088-30b6-4178-b2d5-5032d861a3bf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:15.731904 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-48647088-30b6-4178-b2d5-5032d861a3bf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:15.732350 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-48647088-30b6-4178-b2d5-5032d861a3bf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:15.733109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-48647088-30b6-4178-b2d5-5032d861a3bf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:15.733542 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-48647088-30b6-4178-b2d5-5032d861a3bf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:15.768309 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-bd321c87-1557-4558-8c0b-4632bdc5941b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:15.768857 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-bd321c87-1557-4558-8c0b-4632bdc5941b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:15.775741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bd321c87-1557-4558-8c0b-4632bdc5941b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:15.776109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bd321c87-1557-4558-8c0b-4632bdc5941b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:15.776912 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bd321c87-1557-4558-8c0b-4632bdc5941b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:15.777287 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bd321c87-1557-4558-8c0b-4632bdc5941b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:15.871516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-48647088-30b6-4178-b2d5-5032d861a3bf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:15.880108 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-48647088-30b6-4178-b2d5-5032d861a3bf tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.158727 Jun 21 08:16:15.889533 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 59/123] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:15 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:15.926745 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-bd321c87-1557-4558-8c0b-4632bdc5941b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:15.934216 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-bd321c87-1557-4558-8c0b-4632bdc5941b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.170644 Jun 21 08:16:15.934828 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 65/124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:15 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:16.485185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c8b15dcc-9fdb-46fa-a0a5-d263e528bfcd tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:16.486092 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c8b15dcc-9fdb-46fa-a0a5-d263e528bfcd tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:16.494907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c8b15dcc-9fdb-46fa-a0a5-d263e528bfcd tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:16.507232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c8b15dcc-9fdb-46fa-a0a5-d263e528bfcd tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:16.507232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c8b15dcc-9fdb-46fa-a0a5-d263e528bfcd tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:16.507232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c8b15dcc-9fdb-46fa-a0a5-d263e528bfcd tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:16.557120 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1509e6d8-11d7-4767-94cb-aecf63651cfc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:16.558447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1509e6d8-11d7-4767-94cb-aecf63651cfc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:16.578413 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1509e6d8-11d7-4767-94cb-aecf63651cfc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:16.579226 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1509e6d8-11d7-4767-94cb-aecf63651cfc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:16.580555 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1509e6d8-11d7-4767-94cb-aecf63651cfc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:16.583150 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1509e6d8-11d7-4767-94cb-aecf63651cfc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:16.855181 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1509e6d8-11d7-4767-94cb-aecf63651cfc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:16.867107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1509e6d8-11d7-4767-94cb-aecf63651cfc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.320455 Jun 21 08:16:16.867906 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 66/125] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:16 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:16.899230 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5f5c8467-d686-4e5f-b4e6-c217c74bed18 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:16.900766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5f5c8467-d686-4e5f-b4e6-c217c74bed18 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:16.910333 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5f5c8467-d686-4e5f-b4e6-c217c74bed18 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:16.911007 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5f5c8467-d686-4e5f-b4e6-c217c74bed18 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:16.913116 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5f5c8467-d686-4e5f-b4e6-c217c74bed18 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:16.913394 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5f5c8467-d686-4e5f-b4e6-c217c74bed18 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:17.034865 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c8b15dcc-9fdb-46fa-a0a5-d263e528bfcd tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:17.049514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c8b15dcc-9fdb-46fa-a0a5-d263e528bfcd tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.568825 Jun 21 08:16:17.052340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 60/126] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:16 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:17.059199 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fd35f074-9123-476f-8244-47dad8df4703 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:17.060030 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-fd35f074-9123-476f-8244-47dad8df4703 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:17.068350 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fd35f074-9123-476f-8244-47dad8df4703 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:17.068903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fd35f074-9123-476f-8244-47dad8df4703 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:17.069781 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fd35f074-9123-476f-8244-47dad8df4703 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:17.070250 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fd35f074-9123-476f-8244-47dad8df4703 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:17.117246 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5f5c8467-d686-4e5f-b4e6-c217c74bed18 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:17.125741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5f5c8467-d686-4e5f-b4e6-c217c74bed18 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.231512 Jun 21 08:16:17.127314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 67/127] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:16 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:17.222332 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fd35f074-9123-476f-8244-47dad8df4703 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:17.229939 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fd35f074-9123-476f-8244-47dad8df4703 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.176428 Jun 21 08:16:17.230537 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 61/128] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:17 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:17.885298 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-feaf616d-f571-4c02-b54f-49e1d614b2c6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:17.885914 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-feaf616d-f571-4c02-b54f-49e1d614b2c6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:17.894156 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-feaf616d-f571-4c02-b54f-49e1d614b2c6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:17.894597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-feaf616d-f571-4c02-b54f-49e1d614b2c6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:17.898960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-feaf616d-f571-4c02-b54f-49e1d614b2c6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:17.900752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-feaf616d-f571-4c02-b54f-49e1d614b2c6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:18.027112 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-c5784fd7-97c4-4c21-bb8a-be2947f7cb77 req-1a668e6a-0c55-412f-afed-ee774ee9277b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a94231b-1d32-451c-87ec-0b8264564d27", "name": "network-vif-plugged", "status": "completed", "tag": "1cc80cea-1318-4662-be70-c38f26b1e312"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:18.041125 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-c5784fd7-97c4-4c21-bb8a-be2947f7cb77 req-1a668e6a-0c55-412f-afed-ee774ee9277b service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:18.041901 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-c5784fd7-97c4-4c21-bb8a-be2947f7cb77 req-1a668e6a-0c55-412f-afed-ee774ee9277b service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:18.064703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-c5784fd7-97c4-4c21-bb8a-be2947f7cb77 req-1a668e6a-0c55-412f-afed-ee774ee9277b service nova] Creating event network-vif-plugged:1cc80cea-1318-4662-be70-c38f26b1e312 for instance 7a94231b-1d32-451c-87ec-0b8264564d27 on hv-cinder-83697 Jun 21 08:16:18.071089 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-c5784fd7-97c4-4c21-bb8a-be2947f7cb77 req-1a668e6a-0c55-412f-afed-ee774ee9277b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047618 Jun 21 08:16:18.072291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 62/129] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:18.080064 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-59a73d91-1dca-48fc-b68b-f2a8489a25d9 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:18.081082 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-59a73d91-1dca-48fc-b68b-f2a8489a25d9 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:18.090315 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-59a73d91-1dca-48fc-b68b-f2a8489a25d9 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:18.091062 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-59a73d91-1dca-48fc-b68b-f2a8489a25d9 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:18.092147 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-59a73d91-1dca-48fc-b68b-f2a8489a25d9 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:18.093458 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-59a73d91-1dca-48fc-b68b-f2a8489a25d9 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:18.112230 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-feaf616d-f571-4c02-b54f-49e1d614b2c6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:18.126177 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-feaf616d-f571-4c02-b54f-49e1d614b2c6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.244376 Jun 21 08:16:18.126658 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 68/130] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:17 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:18.147819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8152d6a4-7fe3-484a-8364-fd780713f8af tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:18.148719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8152d6a4-7fe3-484a-8364-fd780713f8af tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:18.169587 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8152d6a4-7fe3-484a-8364-fd780713f8af tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:18.170652 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8152d6a4-7fe3-484a-8364-fd780713f8af tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:18.171775 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8152d6a4-7fe3-484a-8364-fd780713f8af tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:18.172277 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8152d6a4-7fe3-484a-8364-fd780713f8af tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:18.377012 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-59a73d91-1dca-48fc-b68b-f2a8489a25d9 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:18.384965 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=100 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:18.403931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-59a73d91-1dca-48fc-b68b-f2a8489a25d9 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1314 microversion: 2.1 time: 0.323743 Jun 21 08:16:18.405844 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 63/131] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:18 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:18.422273 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3f054827-c8e4-4a15-98b9-07043799d5db tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:18.423557 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3f054827-c8e4-4a15-98b9-07043799d5db tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:18.445845 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3f054827-c8e4-4a15-98b9-07043799d5db tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:18.446866 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3f054827-c8e4-4a15-98b9-07043799d5db tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:18.447657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3f054827-c8e4-4a15-98b9-07043799d5db tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:18.448200 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3f054827-c8e4-4a15-98b9-07043799d5db tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:18.555209 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8152d6a4-7fe3-484a-8364-fd780713f8af tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:18.580496 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8152d6a4-7fe3-484a-8364-fd780713f8af tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1367 microversion: 2.1 time: 0.438058 Jun 21 08:16:18.583305 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 69/132] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:18 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:18.700233 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3f054827-c8e4-4a15-98b9-07043799d5db tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:18.709363 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3f054827-c8e4-4a15-98b9-07043799d5db tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.302159 Jun 21 08:16:18.709947 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 64/133] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:18 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:19.143737 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7560e993-95a3-4458-a830-70a41afe07fb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:19.144285 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7560e993-95a3-4458-a830-70a41afe07fb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:19.150205 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7560e993-95a3-4458-a830-70a41afe07fb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:19.150685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7560e993-95a3-4458-a830-70a41afe07fb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:19.151441 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7560e993-95a3-4458-a830-70a41afe07fb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:19.151859 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7560e993-95a3-4458-a830-70a41afe07fb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:19.283846 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7560e993-95a3-4458-a830-70a41afe07fb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:19.291226 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7560e993-95a3-4458-a830-70a41afe07fb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.151857 Jun 21 08:16:19.291783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 70/134] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:19 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:19.426098 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0bf633e6-b6bc-420a-a5e2-30899d139716 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:19.426784 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0bf633e6-b6bc-420a-a5e2-30899d139716 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:19.432704 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0bf633e6-b6bc-420a-a5e2-30899d139716 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:19.433335 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0bf633e6-b6bc-420a-a5e2-30899d139716 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:19.434101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0bf633e6-b6bc-420a-a5e2-30899d139716 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:19.434537 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0bf633e6-b6bc-420a-a5e2-30899d139716 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:19.570906 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0bf633e6-b6bc-420a-a5e2-30899d139716 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:19.583397 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0bf633e6-b6bc-420a-a5e2-30899d139716 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1501 microversion: 2.1 time: 0.161088 Jun 21 08:16:19.587518 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 65/135] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:19 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:19.604026 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f4019cf5-3f9b-42c0-ac10-e1f78f90c4c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:19.604450 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f4019cf5-3f9b-42c0-ac10-e1f78f90c4c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:19.606885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:19.612506 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f4019cf5-3f9b-42c0-ac10-e1f78f90c4c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:19.612946 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f4019cf5-3f9b-42c0-ac10-e1f78f90c4c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:19.613705 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f4019cf5-3f9b-42c0-ac10-e1f78f90c4c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:19.614150 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f4019cf5-3f9b-42c0-ac10-e1f78f90c4c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:19.726398 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5308aeb7-a55a-452d-9013-41318d7f86cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:19.727273 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5308aeb7-a55a-452d-9013-41318d7f86cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:19.734232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5308aeb7-a55a-452d-9013-41318d7f86cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:19.734893 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5308aeb7-a55a-452d-9013-41318d7f86cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:19.736468 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5308aeb7-a55a-452d-9013-41318d7f86cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:19.737092 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5308aeb7-a55a-452d-9013-41318d7f86cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:19.801072 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f4019cf5-3f9b-42c0-ac10-e1f78f90c4c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:19.810946 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f4019cf5-3f9b-42c0-ac10-e1f78f90c4c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1557 microversion: 2.1 time: 0.210763 Jun 21 08:16:19.811729 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 71/136] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:19 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1557 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:19.835059 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6c645e26-5f69-4ae4-b99f-df2c52e4e953 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:19.836696 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6c645e26-5f69-4ae4-b99f-df2c52e4e953 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:19.848469 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6c645e26-5f69-4ae4-b99f-df2c52e4e953 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:19.849027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6c645e26-5f69-4ae4-b99f-df2c52e4e953 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:19.850558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6c645e26-5f69-4ae4-b99f-df2c52e4e953 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:19.850794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6c645e26-5f69-4ae4-b99f-df2c52e4e953 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:19.902731 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5308aeb7-a55a-452d-9013-41318d7f86cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:19.912439 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5308aeb7-a55a-452d-9013-41318d7f86cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.189719 Jun 21 08:16:19.913438 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 66/137] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:19 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:19.995719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6c645e26-5f69-4ae4-b99f-df2c52e4e953 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169504 Jun 21 08:16:19.996311 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 72/138] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 08:16:19 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:20.157727 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-8a03d2ca-3eca-4588-89a5-cede15d8f9bf req-9b0f2b65-b156-447e-9b80-928a79ed5c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb2c496-4e45-441d-839c-09445870d85e", "name": "network-vif-plugged", "status": "completed", "tag": "26d5d4da-35f8-4ab6-9617-7a5e462e84b3"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:20.165660 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-8a03d2ca-3eca-4588-89a5-cede15d8f9bf req-9b0f2b65-b156-447e-9b80-928a79ed5c95 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:20.166098 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-8a03d2ca-3eca-4588-89a5-cede15d8f9bf req-9b0f2b65-b156-447e-9b80-928a79ed5c95 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:20.177500 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-8a03d2ca-3eca-4588-89a5-cede15d8f9bf req-9b0f2b65-b156-447e-9b80-928a79ed5c95 service nova] Creating event network-vif-plugged:26d5d4da-35f8-4ab6-9617-7a5e462e84b3 for instance dfb2c496-4e45-441d-839c-09445870d85e on hv-cinder-83697 Jun 21 08:16:20.182876 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-8a03d2ca-3eca-4588-89a5-cede15d8f9bf req-9b0f2b65-b156-447e-9b80-928a79ed5c95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028822 Jun 21 08:16:20.183412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 67/139] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:20.308656 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-556f5d74-f414-4417-a5d2-4cb587ba8cf0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:20.309269 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-556f5d74-f414-4417-a5d2-4cb587ba8cf0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:20.317224 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-556f5d74-f414-4417-a5d2-4cb587ba8cf0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:20.317667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-556f5d74-f414-4417-a5d2-4cb587ba8cf0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:20.318540 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-556f5d74-f414-4417-a5d2-4cb587ba8cf0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:20.319058 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-556f5d74-f414-4417-a5d2-4cb587ba8cf0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:20.449723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-556f5d74-f414-4417-a5d2-4cb587ba8cf0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:20.457443 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-556f5d74-f414-4417-a5d2-4cb587ba8cf0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.152650 Jun 21 08:16:20.458103 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 73/140] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:20 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:20.930444 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1b5c249f-5cbb-4898-a8ca-ea3d15846423 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:20.931359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1b5c249f-5cbb-4898-a8ca-ea3d15846423 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:20.940326 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1b5c249f-5cbb-4898-a8ca-ea3d15846423 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:20.940783 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1b5c249f-5cbb-4898-a8ca-ea3d15846423 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:20.941560 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1b5c249f-5cbb-4898-a8ca-ea3d15846423 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:20.942169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1b5c249f-5cbb-4898-a8ca-ea3d15846423 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:21.280552 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1b5c249f-5cbb-4898-a8ca-ea3d15846423 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:21.290338 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1b5c249f-5cbb-4898-a8ca-ea3d15846423 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.364560 Jun 21 08:16:21.291540 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 68/141] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:20 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:21.474737 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-07463ad9-f17a-44ee-a344-2511859c796b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:21.476074 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-07463ad9-f17a-44ee-a344-2511859c796b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:21.482029 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-07463ad9-f17a-44ee-a344-2511859c796b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:21.482493 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-07463ad9-f17a-44ee-a344-2511859c796b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:21.483274 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-07463ad9-f17a-44ee-a344-2511859c796b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:21.483973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-07463ad9-f17a-44ee-a344-2511859c796b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:21.560641 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-cbb02ee2-8924-4cb6-a50e-822a8f5d5fcb req-15f1fc2d-11b2-485c-9109-d839a834acf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c08d704-c754-4c7d-b0f4-540ebde6c782", "tag": "e7af3654-e669-4deb-a185-42a54ed5e149"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:21.577955 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-cbb02ee2-8924-4cb6-a50e-822a8f5d5fcb req-15f1fc2d-11b2-485c-9109-d839a834acf6 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:21.578404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-cbb02ee2-8924-4cb6-a50e-822a8f5d5fcb req-15f1fc2d-11b2-485c-9109-d839a834acf6 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:21.595909 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-cbb02ee2-8924-4cb6-a50e-822a8f5d5fcb req-15f1fc2d-11b2-485c-9109-d839a834acf6 service nova] Creating event network-changed:e7af3654-e669-4deb-a185-42a54ed5e149 for instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 on hv-cinder-83697 Jun 21 08:16:21.602730 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-cbb02ee2-8924-4cb6-a50e-822a8f5d5fcb req-15f1fc2d-11b2-485c-9109-d839a834acf6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046407 Jun 21 08:16:21.604125 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 69/142] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:21.656606 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-07463ad9-f17a-44ee-a344-2511859c796b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:21.664408 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-07463ad9-f17a-44ee-a344-2511859c796b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.194784 Jun 21 08:16:21.673546 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 74/143] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:21 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:22.311789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-19acd484-0ccb-4487-8a95-d1b33dbe46ec tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:22.313102 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-19acd484-0ccb-4487-8a95-d1b33dbe46ec tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:22.321073 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19acd484-0ccb-4487-8a95-d1b33dbe46ec tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:22.322217 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19acd484-0ccb-4487-8a95-d1b33dbe46ec tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:22.323359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19acd484-0ccb-4487-8a95-d1b33dbe46ec tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:22.327224 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19acd484-0ccb-4487-8a95-d1b33dbe46ec tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:22.510135 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-19acd484-0ccb-4487-8a95-d1b33dbe46ec tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:22.521625 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-19acd484-0ccb-4487-8a95-d1b33dbe46ec tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.216004 Jun 21 08:16:22.533574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 70/144] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:22 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:22.681071 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-17866f39-4925-42cb-9767-0c0c8c834fcc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:22.681688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-17866f39-4925-42cb-9767-0c0c8c834fcc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:22.692302 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17866f39-4925-42cb-9767-0c0c8c834fcc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:22.692761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17866f39-4925-42cb-9767-0c0c8c834fcc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:22.693688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17866f39-4925-42cb-9767-0c0c8c834fcc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:22.694136 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17866f39-4925-42cb-9767-0c0c8c834fcc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:22.912829 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-17866f39-4925-42cb-9767-0c0c8c834fcc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:22.924559 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-17866f39-4925-42cb-9767-0c0c8c834fcc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.246199 Jun 21 08:16:22.928828 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 75/145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:22 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:23.322918 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-09f2f2a0-7df1-4e13-9911-9c880f7e3a1f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af71b1a8-abf3-4e77-9df3-21c18361d290"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:23.325344 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-09f2f2a0-7df1-4e13-9911-9c880f7e3a1f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:23.333907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-09f2f2a0-7df1-4e13-9911-9c880f7e3a1f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:23.334716 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-09f2f2a0-7df1-4e13-9911-9c880f7e3a1f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:23.335791 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-09f2f2a0-7df1-4e13-9911-9c880f7e3a1f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:23.336646 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-09f2f2a0-7df1-4e13-9911-9c880f7e3a1f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:23.539962 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-18ce778e-6bdf-4bf7-975c-720b63834d86 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:23.541264 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-18ce778e-6bdf-4bf7-975c-720b63834d86 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:23.550246 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-18ce778e-6bdf-4bf7-975c-720b63834d86 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:23.551043 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-18ce778e-6bdf-4bf7-975c-720b63834d86 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:23.552014 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-18ce778e-6bdf-4bf7-975c-720b63834d86 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:23.553357 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-18ce778e-6bdf-4bf7-975c-720b63834d86 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:23.753651 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-18ce778e-6bdf-4bf7-975c-720b63834d86 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:23.765036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-18ce778e-6bdf-4bf7-975c-720b63834d86 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.229830 Jun 21 08:16:23.765650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 76/146] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:23 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:23.779589 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-09f2f2a0-7df1-4e13-9911-9c880f7e3a1f tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "POST /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461017 Jun 21 08:16:23.780337 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 71/147] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:16:23 2022] POST /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:23.946015 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b1cc6e7f-921f-49fe-bf55-a16b343dc8b1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:23.946776 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b1cc6e7f-921f-49fe-bf55-a16b343dc8b1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:23.953050 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1cc6e7f-921f-49fe-bf55-a16b343dc8b1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:23.953503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1cc6e7f-921f-49fe-bf55-a16b343dc8b1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:23.954611 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1cc6e7f-921f-49fe-bf55-a16b343dc8b1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:23.955423 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1cc6e7f-921f-49fe-bf55-a16b343dc8b1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:24.091172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b1cc6e7f-921f-49fe-bf55-a16b343dc8b1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:24.099245 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b1cc6e7f-921f-49fe-bf55-a16b343dc8b1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1321 microversion: 2.1 time: 0.157205 Jun 21 08:16:24.099810 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 77/148] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:23 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:24.470465 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1411821084", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "networks": [{"uuid": "98d6b797-0aa0-4a78-a53e-fe3421f45339"}]}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:24.524546 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.network.neutron [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] validate_networks() for [('98d6b797-0aa0-4a78-a53e-fe3421f45339', None, None, None, None, None)] {{(pid=117548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:16:24.783597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-64914c7e-03cd-413e-8561-1ac3f5002f83 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:24.784939 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-64914c7e-03cd-413e-8561-1ac3f5002f83 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:24.791972 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-64914c7e-03cd-413e-8561-1ac3f5002f83 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:24.792673 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-64914c7e-03cd-413e-8561-1ac3f5002f83 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:24.793796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-64914c7e-03cd-413e-8561-1ac3f5002f83 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:24.794456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-64914c7e-03cd-413e-8561-1ac3f5002f83 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:24.979900 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-64914c7e-03cd-413e-8561-1ac3f5002f83 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:24.990352 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Flavor limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:16:24.990980 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Image limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:16:24.991458 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Flavor pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:16:24.991894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Image pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:16:24.992379 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:16:24.999808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-64914c7e-03cd-413e-8561-1ac3f5002f83 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.220885 Jun 21 08:16:25.000391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 78/149] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:24 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:25.015927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:25.016396 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:25.017885 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:25.018514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:25.037968 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Getting quotas for project d0ebfe281cb442e18830e44768082fdd. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:16:25.043962 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Getting quotas for user 48e816a85da046fbb8a02f9a84ecd6fb and project d0ebfe281cb442e18830e44768082fdd. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:16:25.060735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Going to run 1 instances... {{(pid=117548) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:16:25.064844 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:16:25.119833 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2253ceba-9ecf-49c1-b15b-d744fc41dc44 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653959 Jun 21 08:16:25.120408 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 72/150] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:16:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:16:25.124894 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-41edcdcb-da6a-4ee6-bd00-f3b1efdca50f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:25.131307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-41edcdcb-da6a-4ee6-bd00-f3b1efdca50f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:25.131639 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1ba47a1d-0464-4642-9c8d-19b5904c91fa tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:25.132490 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1ba47a1d-0464-4642-9c8d-19b5904c91fa tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:25.140989 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41edcdcb-da6a-4ee6-bd00-f3b1efdca50f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:25.141431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41edcdcb-da6a-4ee6-bd00-f3b1efdca50f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:25.148657 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41edcdcb-da6a-4ee6-bd00-f3b1efdca50f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:25.149688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41edcdcb-da6a-4ee6-bd00-f3b1efdca50f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:25.191079 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1ba47a1d-0464-4642-9c8d-19b5904c91fa tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:25.201967 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1ba47a1d-0464-4642-9c8d-19b5904c91fa tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1214 microversion: 2.1 time: 0.074181 Jun 21 08:16:25.203112 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 73/151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:25 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:25.349391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-41edcdcb-da6a-4ee6-bd00-f3b1efdca50f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:25.358021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-41edcdcb-da6a-4ee6-bd00-f3b1efdca50f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1515 microversion: 2.1 time: 0.245224 Jun 21 08:16:25.358900 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 79/152] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:25 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:25.378171 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-20f694ec-6e21-421c-89e4-4245cc3ef5ec tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:25.381090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-20f694ec-6e21-421c-89e4-4245cc3ef5ec tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:25.390002 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-20f694ec-6e21-421c-89e4-4245cc3ef5ec tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:25.390742 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-20f694ec-6e21-421c-89e4-4245cc3ef5ec tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:25.392765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-20f694ec-6e21-421c-89e4-4245cc3ef5ec tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:25.393945 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-20f694ec-6e21-421c-89e4-4245cc3ef5ec tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:25.421568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-20f694ec-6e21-421c-89e4-4245cc3ef5ec tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lazy-loading 'flavor' on Instance uuid 7a94231b-1d32-451c-87ec-0b8264564d27 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:16:25.549685 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-20f694ec-6e21-421c-89e4-4245cc3ef5ec tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27/action" status: 200 len: 32 microversion: 2.1 time: 0.176970 Jun 21 08:16:25.550572 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 74/153] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:16:25 2022] POST /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:16:25.559807 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-88122e5e-923d-448b-93cd-8a21877c966f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:25.560413 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-88122e5e-923d-448b-93cd-8a21877c966f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:25.567406 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-88122e5e-923d-448b-93cd-8a21877c966f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:25.567852 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-88122e5e-923d-448b-93cd-8a21877c966f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:25.568606 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-88122e5e-923d-448b-93cd-8a21877c966f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:25.569229 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-88122e5e-923d-448b-93cd-8a21877c966f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:25.574195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:25.714936 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-88122e5e-923d-448b-93cd-8a21877c966f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:25.722532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-88122e5e-923d-448b-93cd-8a21877c966f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.166466 Jun 21 08:16:25.723134 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 80/154] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:25 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:26.019959 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-888df6ef-d9fd-4bce-a6ca-6cec8070cf9d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:26.020658 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-888df6ef-d9fd-4bce-a6ca-6cec8070cf9d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:26.026928 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-888df6ef-d9fd-4bce-a6ca-6cec8070cf9d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:26.027379 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-888df6ef-d9fd-4bce-a6ca-6cec8070cf9d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:26.028165 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-888df6ef-d9fd-4bce-a6ca-6cec8070cf9d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:26.028597 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-888df6ef-d9fd-4bce-a6ca-6cec8070cf9d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:26.160000 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-888df6ef-d9fd-4bce-a6ca-6cec8070cf9d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:26.167358 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-888df6ef-d9fd-4bce-a6ca-6cec8070cf9d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.152565 Jun 21 08:16:26.167915 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 75/155] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:26 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:26.218905 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-12260fbd-978d-4704-b232-099295ae4279 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:26.219523 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-12260fbd-978d-4704-b232-099295ae4279 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:26.226121 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-12260fbd-978d-4704-b232-099295ae4279 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:26.226568 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-12260fbd-978d-4704-b232-099295ae4279 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:26.227355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-12260fbd-978d-4704-b232-099295ae4279 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:26.227793 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-12260fbd-978d-4704-b232-099295ae4279 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:26.286819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-12260fbd-978d-4704-b232-099295ae4279 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:26.293988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-12260fbd-978d-4704-b232-099295ae4279 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1218 microversion: 2.1 time: 0.078832 Jun 21 08:16:26.294550 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 81/156] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:26 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:26.739317 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1ffd23d9-cddc-4865-ac18-16c64e729f5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:26.739914 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1ffd23d9-cddc-4865-ac18-16c64e729f5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:26.743353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:26.747270 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ffd23d9-cddc-4865-ac18-16c64e729f5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:26.747720 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ffd23d9-cddc-4865-ac18-16c64e729f5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:26.748719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ffd23d9-cddc-4865-ac18-16c64e729f5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:26.749156 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ffd23d9-cddc-4865-ac18-16c64e729f5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:26.875649 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1ffd23d9-cddc-4865-ac18-16c64e729f5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:26.883936 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1ffd23d9-cddc-4865-ac18-16c64e729f5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.149015 Jun 21 08:16:26.884553 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 76/157] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:26 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:27.184040 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-31939b73-6ec2-45d1-93c4-4c20562651d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:27.184647 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-31939b73-6ec2-45d1-93c4-4c20562651d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:27.191262 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31939b73-6ec2-45d1-93c4-4c20562651d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:27.191709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31939b73-6ec2-45d1-93c4-4c20562651d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:27.192457 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31939b73-6ec2-45d1-93c4-4c20562651d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:27.192886 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31939b73-6ec2-45d1-93c4-4c20562651d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:27.310895 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-66237999-127f-4230-ac31-ef326db2a72e tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:27.311617 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-66237999-127f-4230-ac31-ef326db2a72e tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:27.318388 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-66237999-127f-4230-ac31-ef326db2a72e tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:27.318952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-66237999-127f-4230-ac31-ef326db2a72e tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:27.319861 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-66237999-127f-4230-ac31-ef326db2a72e tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:27.320321 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-66237999-127f-4230-ac31-ef326db2a72e tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:27.333212 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-31939b73-6ec2-45d1-93c4-4c20562651d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:27.340726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-31939b73-6ec2-45d1-93c4-4c20562651d7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.160463 Jun 21 08:16:27.341559 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 82/158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:27 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:27.380733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-66237999-127f-4230-ac31-ef326db2a72e tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:27.387987 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-66237999-127f-4230-ac31-ef326db2a72e tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1218 microversion: 2.1 time: 0.080939 Jun 21 08:16:27.388555 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 77/159] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:27 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:27.901319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-89338a5a-c751-441f-87df-9c08f200d44f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:27.901934 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-89338a5a-c751-441f-87df-9c08f200d44f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:27.908820 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-89338a5a-c751-441f-87df-9c08f200d44f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:27.909306 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-89338a5a-c751-441f-87df-9c08f200d44f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:27.910083 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-89338a5a-c751-441f-87df-9c08f200d44f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:27.910522 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-89338a5a-c751-441f-87df-9c08f200d44f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:28.045832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-89338a5a-c751-441f-87df-9c08f200d44f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:28.053891 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-89338a5a-c751-441f-87df-9c08f200d44f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.156416 Jun 21 08:16:28.054452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 83/160] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:27 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:28.358040 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3bc99787-3431-4233-8227-5c7dd218fc69 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:28.358576 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3bc99787-3431-4233-8227-5c7dd218fc69 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:28.365022 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3bc99787-3431-4233-8227-5c7dd218fc69 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:28.365471 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3bc99787-3431-4233-8227-5c7dd218fc69 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:28.366229 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3bc99787-3431-4233-8227-5c7dd218fc69 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:28.366711 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3bc99787-3431-4233-8227-5c7dd218fc69 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:28.404551 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-79c85f6b-1ca2-4e20-ab99-75a2d813988d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:28.405759 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-79c85f6b-1ca2-4e20-ab99-75a2d813988d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:28.411336 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-79c85f6b-1ca2-4e20-ab99-75a2d813988d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:28.411783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-79c85f6b-1ca2-4e20-ab99-75a2d813988d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:28.412544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-79c85f6b-1ca2-4e20-ab99-75a2d813988d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:28.412973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-79c85f6b-1ca2-4e20-ab99-75a2d813988d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:28.496181 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-79c85f6b-1ca2-4e20-ab99-75a2d813988d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:28.506781 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-79c85f6b-1ca2-4e20-ab99-75a2d813988d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1218 microversion: 2.1 time: 0.105185 Jun 21 08:16:28.517510 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 84/161] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:28 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:28.912989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3bc99787-3431-4233-8227-5c7dd218fc69 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:28.933514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3bc99787-3431-4233-8227-5c7dd218fc69 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1363 microversion: 2.1 time: 0.577677 Jun 21 08:16:28.934128 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 78/162] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:28 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1363 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:29.072123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-542e774a-32fc-4765-bdd7-b7629a393340 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:29.073095 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-542e774a-32fc-4765-bdd7-b7629a393340 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:29.080396 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-542e774a-32fc-4765-bdd7-b7629a393340 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:29.081096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-542e774a-32fc-4765-bdd7-b7629a393340 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:29.082021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-542e774a-32fc-4765-bdd7-b7629a393340 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:29.082666 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-542e774a-32fc-4765-bdd7-b7629a393340 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:29.225994 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-542e774a-32fc-4765-bdd7-b7629a393340 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:29.233554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-542e774a-32fc-4765-bdd7-b7629a393340 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.166472 Jun 21 08:16:29.234112 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 85/163] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:29 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:29.524004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9be55b33-5f2d-45c0-ae0d-b2e4194c3561 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:29.524650 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-9be55b33-5f2d-45c0-ae0d-b2e4194c3561 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:29.531007 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9be55b33-5f2d-45c0-ae0d-b2e4194c3561 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:29.531448 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9be55b33-5f2d-45c0-ae0d-b2e4194c3561 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:29.533036 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9be55b33-5f2d-45c0-ae0d-b2e4194c3561 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:29.533550 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9be55b33-5f2d-45c0-ae0d-b2e4194c3561 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:29.594416 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-9be55b33-5f2d-45c0-ae0d-b2e4194c3561 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:29.602348 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9be55b33-5f2d-45c0-ae0d-b2e4194c3561 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1266 microversion: 2.1 time: 0.082174 Jun 21 08:16:29.602952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 79/164] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:29 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:29.951337 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e12d5571-bd5a-4f10-976a-15ad47b3cd20 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:29.952532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e12d5571-bd5a-4f10-976a-15ad47b3cd20 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:29.959275 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e12d5571-bd5a-4f10-976a-15ad47b3cd20 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:29.959766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e12d5571-bd5a-4f10-976a-15ad47b3cd20 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:29.960493 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e12d5571-bd5a-4f10-976a-15ad47b3cd20 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:29.961014 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e12d5571-bd5a-4f10-976a-15ad47b3cd20 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:30.105503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e12d5571-bd5a-4f10-976a-15ad47b3cd20 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:30.112978 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e12d5571-bd5a-4f10-976a-15ad47b3cd20 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1549 microversion: 2.1 time: 0.165909 Jun 21 08:16:30.113550 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 86/165] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:29 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:30.130121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d0514524-3556-41d3-b1db-f34aeb432321 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:30.130634 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d0514524-3556-41d3-b1db-f34aeb432321 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:30.136613 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d0514524-3556-41d3-b1db-f34aeb432321 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:30.137066 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d0514524-3556-41d3-b1db-f34aeb432321 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:30.137826 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d0514524-3556-41d3-b1db-f34aeb432321 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:30.138260 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d0514524-3556-41d3-b1db-f34aeb432321 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:30.142473 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:30.252232 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d23b75ef-d09d-4d1d-b8e3-e26db3cf5c0d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:30.253183 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d23b75ef-d09d-4d1d-b8e3-e26db3cf5c0d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:30.261540 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d23b75ef-d09d-4d1d-b8e3-e26db3cf5c0d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:30.262377 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d23b75ef-d09d-4d1d-b8e3-e26db3cf5c0d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:30.263845 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d23b75ef-d09d-4d1d-b8e3-e26db3cf5c0d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:30.264938 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d23b75ef-d09d-4d1d-b8e3-e26db3cf5c0d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:30.379536 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d0514524-3556-41d3-b1db-f34aeb432321 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.253625 Jun 21 08:16:30.380540 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 80/166] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 08:16:30 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/os-interface => generated 285 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:30.619852 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6ae9b33d-c455-4022-80f4-1b5df419e585 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:30.620485 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6ae9b33d-c455-4022-80f4-1b5df419e585 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:30.632407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6ae9b33d-c455-4022-80f4-1b5df419e585 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:30.632869 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6ae9b33d-c455-4022-80f4-1b5df419e585 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:30.633655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6ae9b33d-c455-4022-80f4-1b5df419e585 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:30.634088 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6ae9b33d-c455-4022-80f4-1b5df419e585 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:30.806948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d23b75ef-d09d-4d1d-b8e3-e26db3cf5c0d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:30.818341 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d23b75ef-d09d-4d1d-b8e3-e26db3cf5c0d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.569826 Jun 21 08:16:30.819528 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 87/167] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:30 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:30.873082 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6ae9b33d-c455-4022-80f4-1b5df419e585 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:30.885753 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6ae9b33d-c455-4022-80f4-1b5df419e585 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1272 microversion: 2.1 time: 0.269279 Jun 21 08:16:30.888164 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 81/168] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:30 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:31.836407 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-429bd453-e9a3-4aca-8b7f-22ee361853af tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:31.837234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-429bd453-e9a3-4aca-8b7f-22ee361853af tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:31.847064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-429bd453-e9a3-4aca-8b7f-22ee361853af tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:31.847552 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-429bd453-e9a3-4aca-8b7f-22ee361853af tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:31.848496 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-429bd453-e9a3-4aca-8b7f-22ee361853af tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:31.849099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-429bd453-e9a3-4aca-8b7f-22ee361853af tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:31.911896 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-90aefd46-88f0-4001-85f9-91d0333799d3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:31.912789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-90aefd46-88f0-4001-85f9-91d0333799d3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:31.922300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-90aefd46-88f0-4001-85f9-91d0333799d3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:31.922814 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-90aefd46-88f0-4001-85f9-91d0333799d3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:31.923954 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-90aefd46-88f0-4001-85f9-91d0333799d3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:31.925459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-90aefd46-88f0-4001-85f9-91d0333799d3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:32.151992 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-429bd453-e9a3-4aca-8b7f-22ee361853af tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:32.167719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-429bd453-e9a3-4aca-8b7f-22ee361853af tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.335294 Jun 21 08:16:32.181273 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 88/169] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:31 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:32.203351 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-0a5ea29a-b01d-4c30-bbbf-f85cdf8e4a4d req-eb68a643-75bf-49db-b0a4-d1f9658fcc0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb2c496-4e45-441d-839c-09445870d85e", "tag": "26d5d4da-35f8-4ab6-9617-7a5e462e84b3"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:32.213891 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-0a5ea29a-b01d-4c30-bbbf-f85cdf8e4a4d req-eb68a643-75bf-49db-b0a4-d1f9658fcc0a service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:32.215261 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-0a5ea29a-b01d-4c30-bbbf-f85cdf8e4a4d req-eb68a643-75bf-49db-b0a4-d1f9658fcc0a service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:32.237428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-0a5ea29a-b01d-4c30-bbbf-f85cdf8e4a4d req-eb68a643-75bf-49db-b0a4-d1f9658fcc0a service nova] Creating event network-changed:26d5d4da-35f8-4ab6-9617-7a5e462e84b3 for instance dfb2c496-4e45-441d-839c-09445870d85e on hv-cinder-83697 Jun 21 08:16:32.247777 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-0a5ea29a-b01d-4c30-bbbf-f85cdf8e4a4d req-eb68a643-75bf-49db-b0a4-d1f9658fcc0a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051367 Jun 21 08:16:32.249439 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 89/170] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:32.264792 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-90aefd46-88f0-4001-85f9-91d0333799d3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:32.274554 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-90aefd46-88f0-4001-85f9-91d0333799d3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1314 microversion: 2.1 time: 0.370672 Jun 21 08:16:32.275412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 82/171] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:31 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:33.186854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a0d1b138-aeed-476a-9b7d-1b5dd3410e6d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:33.187552 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a0d1b138-aeed-476a-9b7d-1b5dd3410e6d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:33.200491 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0d1b138-aeed-476a-9b7d-1b5dd3410e6d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:33.201227 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0d1b138-aeed-476a-9b7d-1b5dd3410e6d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:33.205865 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0d1b138-aeed-476a-9b7d-1b5dd3410e6d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:33.206934 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0d1b138-aeed-476a-9b7d-1b5dd3410e6d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:33.292558 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ad4376a4-e000-4751-8d35-1880a0500acf tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:33.293170 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-ad4376a4-e000-4751-8d35-1880a0500acf tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:33.301658 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ad4376a4-e000-4751-8d35-1880a0500acf tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:33.302117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ad4376a4-e000-4751-8d35-1880a0500acf tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:33.302970 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ad4376a4-e000-4751-8d35-1880a0500acf tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:33.304088 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ad4376a4-e000-4751-8d35-1880a0500acf tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:33.396521 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a0d1b138-aeed-476a-9b7d-1b5dd3410e6d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:33.406655 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a0d1b138-aeed-476a-9b7d-1b5dd3410e6d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.222608 Jun 21 08:16:33.409809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 90/172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:33 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:33.765933 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-ad4376a4-e000-4751-8d35-1880a0500acf tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:33.779284 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ad4376a4-e000-4751-8d35-1880a0500acf tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1314 microversion: 2.1 time: 0.489325 Jun 21 08:16:33.780167 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 83/173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:33 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:33.913227 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-5007602c-3f1b-46c3-90f6-30ec562e0746 req-0b5708a1-3b59-4796-b5f9-62d92a2d0c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea8d802-64a9-4160-b50d-daa8bee0c56d", "tag": "90a66523-b3bd-4fd9-a1b9-e5917bcdbb1c"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:33.930319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-5007602c-3f1b-46c3-90f6-30ec562e0746 req-0b5708a1-3b59-4796-b5f9-62d92a2d0c28 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:33.931015 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-5007602c-3f1b-46c3-90f6-30ec562e0746 req-0b5708a1-3b59-4796-b5f9-62d92a2d0c28 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:33.952612 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-5007602c-3f1b-46c3-90f6-30ec562e0746 req-0b5708a1-3b59-4796-b5f9-62d92a2d0c28 service nova] Creating event network-changed:90a66523-b3bd-4fd9-a1b9-e5917bcdbb1c for instance 1ea8d802-64a9-4160-b50d-daa8bee0c56d on hv-cinder-83697 Jun 21 08:16:33.965248 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-5007602c-3f1b-46c3-90f6-30ec562e0746 req-0b5708a1-3b59-4796-b5f9-62d92a2d0c28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053590 Jun 21 08:16:33.969038 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 91/174] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:34.435891 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-010111c5-8412-4f46-a10d-68a23bcd68ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:34.439152 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-010111c5-8412-4f46-a10d-68a23bcd68ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:34.459040 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-010111c5-8412-4f46-a10d-68a23bcd68ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:34.461342 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-010111c5-8412-4f46-a10d-68a23bcd68ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:34.463428 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-010111c5-8412-4f46-a10d-68a23bcd68ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:34.465211 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-010111c5-8412-4f46-a10d-68a23bcd68ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:34.756826 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-010111c5-8412-4f46-a10d-68a23bcd68ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:34.769010 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-010111c5-8412-4f46-a10d-68a23bcd68ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.345853 Jun 21 08:16:34.770503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 84/175] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:34 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:34.797309 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-517ff4b7-a0c8-4227-9c4d-06356a177739 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:34.798220 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-517ff4b7-a0c8-4227-9c4d-06356a177739 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:34.811975 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-517ff4b7-a0c8-4227-9c4d-06356a177739 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:34.812558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-517ff4b7-a0c8-4227-9c4d-06356a177739 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:34.813538 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-517ff4b7-a0c8-4227-9c4d-06356a177739 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:34.814167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-517ff4b7-a0c8-4227-9c4d-06356a177739 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:34.970767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-517ff4b7-a0c8-4227-9c4d-06356a177739 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:34.982050 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-517ff4b7-a0c8-4227-9c4d-06356a177739 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1314 microversion: 2.1 time: 0.188821 Jun 21 08:16:34.983044 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 92/176] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:34 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:35.787471 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-53069d9a-6935-4f09-8646-c409b6bbade3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:35.788203 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-53069d9a-6935-4f09-8646-c409b6bbade3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:35.790176 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:35.790945 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=8 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:35.798661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-53069d9a-6935-4f09-8646-c409b6bbade3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:35.799704 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-53069d9a-6935-4f09-8646-c409b6bbade3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:35.800604 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-53069d9a-6935-4f09-8646-c409b6bbade3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:35.801109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-53069d9a-6935-4f09-8646-c409b6bbade3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:35.965310 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-53069d9a-6935-4f09-8646-c409b6bbade3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:35.974552 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-53069d9a-6935-4f09-8646-c409b6bbade3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.191504 Jun 21 08:16:35.975767 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 85/177] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:35 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:36.002215 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9ecdb4a2-1ea7-4376-8586-df1146d4f8c9 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:36.002982 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9ecdb4a2-1ea7-4376-8586-df1146d4f8c9 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:36.010921 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9ecdb4a2-1ea7-4376-8586-df1146d4f8c9 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:36.011360 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9ecdb4a2-1ea7-4376-8586-df1146d4f8c9 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:36.013298 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9ecdb4a2-1ea7-4376-8586-df1146d4f8c9 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:36.013884 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9ecdb4a2-1ea7-4376-8586-df1146d4f8c9 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:36.193907 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9ecdb4a2-1ea7-4376-8586-df1146d4f8c9 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:36.202334 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9ecdb4a2-1ea7-4376-8586-df1146d4f8c9 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1314 microversion: 2.1 time: 0.204678 Jun 21 08:16:36.203603 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 93/178] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:35 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:36.993872 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-50f19f81-7f25-450e-949d-45c760529f5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:36.994594 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-50f19f81-7f25-450e-949d-45c760529f5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:37.003673 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-50f19f81-7f25-450e-949d-45c760529f5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:37.004112 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-50f19f81-7f25-450e-949d-45c760529f5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:37.005314 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-50f19f81-7f25-450e-949d-45c760529f5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:37.005960 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-50f19f81-7f25-450e-949d-45c760529f5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:37.170218 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-50f19f81-7f25-450e-949d-45c760529f5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:37.178450 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-50f19f81-7f25-450e-949d-45c760529f5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.188941 Jun 21 08:16:37.179366 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 86/179] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:36 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:37.221659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4b82af62-b3aa-425c-9267-98ba45a120af tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:37.222392 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4b82af62-b3aa-425c-9267-98ba45a120af tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:37.259763 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4b82af62-b3aa-425c-9267-98ba45a120af tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:37.263648 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4b82af62-b3aa-425c-9267-98ba45a120af tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:37.267158 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4b82af62-b3aa-425c-9267-98ba45a120af tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:37.267677 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4b82af62-b3aa-425c-9267-98ba45a120af tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:37.510258 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4b82af62-b3aa-425c-9267-98ba45a120af tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:37.518324 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4b82af62-b3aa-425c-9267-98ba45a120af tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1314 microversion: 2.1 time: 0.302499 Jun 21 08:16:37.527772 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 94/180] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:37 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:38.055205 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f39d6779-5fcb-489f-9dea-7ff87354d1f1 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:38.056437 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f39d6779-5fcb-489f-9dea-7ff87354d1f1 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:38.069124 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f39d6779-5fcb-489f-9dea-7ff87354d1f1 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:38.070910 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f39d6779-5fcb-489f-9dea-7ff87354d1f1 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:38.074664 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f39d6779-5fcb-489f-9dea-7ff87354d1f1 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:38.075622 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f39d6779-5fcb-489f-9dea-7ff87354d1f1 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:38.106539 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f39d6779-5fcb-489f-9dea-7ff87354d1f1 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:16:38.171737 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-451e348a-e89a-437f-a017-f1c9c0e091c2 req-5dc5d729-8195-46f0-8b5d-2db49931845f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea8d802-64a9-4160-b50d-daa8bee0c56d", "name": "network-vif-plugged", "status": "completed", "tag": "90a66523-b3bd-4fd9-a1b9-e5917bcdbb1c"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:38.190929 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-451e348a-e89a-437f-a017-f1c9c0e091c2 req-5dc5d729-8195-46f0-8b5d-2db49931845f service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:38.191409 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-451e348a-e89a-437f-a017-f1c9c0e091c2 req-5dc5d729-8195-46f0-8b5d-2db49931845f service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:38.224211 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-451e348a-e89a-437f-a017-f1c9c0e091c2 req-5dc5d729-8195-46f0-8b5d-2db49931845f service nova] Creating event network-vif-plugged:90a66523-b3bd-4fd9-a1b9-e5917bcdbb1c for instance 1ea8d802-64a9-4160-b50d-daa8bee0c56d on hv-cinder-83697 Jun 21 08:16:38.235357 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-451e348a-e89a-437f-a017-f1c9c0e091c2 req-5dc5d729-8195-46f0-8b5d-2db49931845f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065915 Jun 21 08:16:38.236714 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 95/181] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:16:38.244679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b8b0e879-cc15-454a-80d3-f17988b2cec2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:38.245870 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b8b0e879-cc15-454a-80d3-f17988b2cec2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:38.255834 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b8b0e879-cc15-454a-80d3-f17988b2cec2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:38.256997 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b8b0e879-cc15-454a-80d3-f17988b2cec2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:38.258011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b8b0e879-cc15-454a-80d3-f17988b2cec2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:38.258720 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b8b0e879-cc15-454a-80d3-f17988b2cec2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:38.295931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f39d6779-5fcb-489f-9dea-7ff87354d1f1 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 204 len: 0 microversion: 2.1 time: 0.244908 Jun 21 08:16:38.297069 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 87/182] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:16:38 2022] DELETE /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:16:38.308128 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bc44af15-e1fd-404a-b00b-8bd1d9c4e229 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:38.309416 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bc44af15-e1fd-404a-b00b-8bd1d9c4e229 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:38.319579 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bc44af15-e1fd-404a-b00b-8bd1d9c4e229 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:38.320473 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bc44af15-e1fd-404a-b00b-8bd1d9c4e229 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:38.321773 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bc44af15-e1fd-404a-b00b-8bd1d9c4e229 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:38.322736 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bc44af15-e1fd-404a-b00b-8bd1d9c4e229 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:38.486172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b8b0e879-cc15-454a-80d3-f17988b2cec2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:38.495065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b8b0e879-cc15-454a-80d3-f17988b2cec2 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.256885 Jun 21 08:16:38.496417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 96/183] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:38 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:38.502786 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bc44af15-e1fd-404a-b00b-8bd1d9c4e229 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:38.514080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bc44af15-e1fd-404a-b00b-8bd1d9c4e229 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1553 microversion: 2.1 time: 0.210894 Jun 21 08:16:38.522006 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 88/184] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:38 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:38.537615 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-437d58fb-e8c3-45db-bad8-46111035cb30 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:38.538417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-437d58fb-e8c3-45db-bad8-46111035cb30 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:38.544676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-437d58fb-e8c3-45db-bad8-46111035cb30 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:38.545190 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-437d58fb-e8c3-45db-bad8-46111035cb30 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:38.545978 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-437d58fb-e8c3-45db-bad8-46111035cb30 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:38.546565 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-437d58fb-e8c3-45db-bad8-46111035cb30 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:38.741328 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-437d58fb-e8c3-45db-bad8-46111035cb30 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:38.753416 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-437d58fb-e8c3-45db-bad8-46111035cb30 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1314 microversion: 2.1 time: 0.221901 Jun 21 08:16:38.754018 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 97/185] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:38 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:39.513121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-852636a6-dff6-41e0-9671-24221930da2b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:39.513737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-852636a6-dff6-41e0-9671-24221930da2b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:39.520739 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-852636a6-dff6-41e0-9671-24221930da2b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:39.521181 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-852636a6-dff6-41e0-9671-24221930da2b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:39.521941 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-852636a6-dff6-41e0-9671-24221930da2b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:39.522368 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-852636a6-dff6-41e0-9671-24221930da2b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:39.532421 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7ee681a7-04cc-472b-9b14-77fed4df47dc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:39.534428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7ee681a7-04cc-472b-9b14-77fed4df47dc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:39.540794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7ee681a7-04cc-472b-9b14-77fed4df47dc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:39.541248 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7ee681a7-04cc-472b-9b14-77fed4df47dc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:39.542508 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7ee681a7-04cc-472b-9b14-77fed4df47dc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:39.543172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7ee681a7-04cc-472b-9b14-77fed4df47dc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:39.674483 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-852636a6-dff6-41e0-9671-24221930da2b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:39.683429 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-852636a6-dff6-41e0-9671-24221930da2b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.174063 Jun 21 08:16:39.684210 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 89/186] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:39 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:39.696234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7ee681a7-04cc-472b-9b14-77fed4df47dc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:39.700074 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:39.707206 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7ee681a7-04cc-472b-9b14-77fed4df47dc tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1553 microversion: 2.1 time: 0.179044 Jun 21 08:16:39.707778 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 98/187] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:39 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:39.771117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-137cf754-d6c0-4aa4-85e5-90c323886845 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:39.771933 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-137cf754-d6c0-4aa4-85e5-90c323886845 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:39.777816 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-137cf754-d6c0-4aa4-85e5-90c323886845 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:39.778269 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-137cf754-d6c0-4aa4-85e5-90c323886845 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:39.779052 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-137cf754-d6c0-4aa4-85e5-90c323886845 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:39.779485 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-137cf754-d6c0-4aa4-85e5-90c323886845 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:39.917183 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-137cf754-d6c0-4aa4-85e5-90c323886845 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:39.926252 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-137cf754-d6c0-4aa4-85e5-90c323886845 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1314 microversion: 2.1 time: 0.158863 Jun 21 08:16:39.926853 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 90/188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:39 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:40.065189 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1496999709", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452"}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:40.122712 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] validate_networks() for None {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:16:40.446937 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:16:40.447398 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:16:40.447871 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:16:40.448283 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:16:40.448698 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:16:40.458843 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:40.459296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:40.460096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:40.460532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:40.477866 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Getting quotas for project b791fbed0800400290c38ac5f481ec60. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:16:40.481828 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Getting quotas for user 4bd2d93a30444c8fa6de094160f0ad97 and project b791fbed0800400290c38ac5f481ec60. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:16:40.493022 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:16:40.495308 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:16:40.545645 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6e7916f9-1dda-4e9b-a25b-f3f93daec30c tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486586 Jun 21 08:16:40.552474 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 99/189] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:16:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:16:40.559075 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-285d300d-b1b5-417b-8170-1f899af5f307 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:40.560414 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-285d300d-b1b5-417b-8170-1f899af5f307 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:40.638132 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-285d300d-b1b5-417b-8170-1f899af5f307 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:40.647220 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-285d300d-b1b5-417b-8170-1f899af5f307 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1215 microversion: 2.1 time: 0.093062 Jun 21 08:16:40.647788 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 91/190] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:40 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:40.705119 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5e64cb35-09d8-476f-b69c-dbb32ecc0090 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:40.705738 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5e64cb35-09d8-476f-b69c-dbb32ecc0090 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:40.712244 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5e64cb35-09d8-476f-b69c-dbb32ecc0090 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:40.712702 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5e64cb35-09d8-476f-b69c-dbb32ecc0090 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:40.713475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5e64cb35-09d8-476f-b69c-dbb32ecc0090 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:40.713911 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5e64cb35-09d8-476f-b69c-dbb32ecc0090 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:40.728709 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f443989d-5a0a-413c-a1ab-0582fc5380f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:40.729802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f443989d-5a0a-413c-a1ab-0582fc5380f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:40.738353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f443989d-5a0a-413c-a1ab-0582fc5380f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:40.739723 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f443989d-5a0a-413c-a1ab-0582fc5380f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:40.741214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f443989d-5a0a-413c-a1ab-0582fc5380f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:40.742042 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f443989d-5a0a-413c-a1ab-0582fc5380f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:40.892743 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f443989d-5a0a-413c-a1ab-0582fc5380f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:40.901203 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f443989d-5a0a-413c-a1ab-0582fc5380f2 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1553 microversion: 2.1 time: 0.178305 Jun 21 08:16:40.901778 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 92/191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:40 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:40.927164 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5e64cb35-09d8-476f-b69c-dbb32ecc0090 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:40.935245 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5e64cb35-09d8-476f-b69c-dbb32ecc0090 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.234959 Jun 21 08:16:40.936094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 100/192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:40 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:40.943636 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5bc655d1-70de-4652-a894-084ae90d4a9b tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:40.944649 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5bc655d1-70de-4652-a894-084ae90d4a9b tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:40.951772 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5bc655d1-70de-4652-a894-084ae90d4a9b tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:40.952315 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5bc655d1-70de-4652-a894-084ae90d4a9b tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:40.953199 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5bc655d1-70de-4652-a894-084ae90d4a9b tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:40.953848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5bc655d1-70de-4652-a894-084ae90d4a9b tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:41.167342 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5bc655d1-70de-4652-a894-084ae90d4a9b tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:41.176461 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5bc655d1-70de-4652-a894-084ae90d4a9b tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1314 microversion: 2.1 time: 0.236493 Jun 21 08:16:41.177143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 93/193] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:40 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:41.666444 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3600c9d1-4465-49cd-8e5f-c62abd574dbc tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:41.675319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3600c9d1-4465-49cd-8e5f-c62abd574dbc tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:41.693581 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3600c9d1-4465-49cd-8e5f-c62abd574dbc tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:41.694480 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3600c9d1-4465-49cd-8e5f-c62abd574dbc tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:41.696879 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3600c9d1-4465-49cd-8e5f-c62abd574dbc tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:41.700422 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3600c9d1-4465-49cd-8e5f-c62abd574dbc tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:41.833031 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-3600c9d1-4465-49cd-8e5f-c62abd574dbc tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:41.844867 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3600c9d1-4465-49cd-8e5f-c62abd574dbc tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1267 microversion: 2.1 time: 0.184212 Jun 21 08:16:41.863679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 101/194] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:41 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:41.890547 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-e80c0588-5f42-4bfa-954e-6ff804f100c1 req-e98105d3-53b2-4db3-b5e1-0d861002ccd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a986f1a9-57eb-4763-9487-8312fb029ae9", "name": "network-vif-deleted", "tag": "ce685fa0-a928-459e-a8b1-21743bcb9479"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:41.902184 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-e80c0588-5f42-4bfa-954e-6ff804f100c1 req-e98105d3-53b2-4db3-b5e1-0d861002ccd9 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:41.902818 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-e80c0588-5f42-4bfa-954e-6ff804f100c1 req-e98105d3-53b2-4db3-b5e1-0d861002ccd9 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:41.920292 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a84c9b8c-3900-409b-8ede-fbaaedfde162 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:41.921658 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a84c9b8c-3900-409b-8ede-fbaaedfde162 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:41.932355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a84c9b8c-3900-409b-8ede-fbaaedfde162 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:41.933273 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-e80c0588-5f42-4bfa-954e-6ff804f100c1 req-e98105d3-53b2-4db3-b5e1-0d861002ccd9 service nova] Creating event network-vif-deleted:ce685fa0-a928-459e-a8b1-21743bcb9479 for instance a986f1a9-57eb-4763-9487-8312fb029ae9 on hv-cinder-83697 Jun 21 08:16:41.934920 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a84c9b8c-3900-409b-8ede-fbaaedfde162 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:41.937813 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a84c9b8c-3900-409b-8ede-fbaaedfde162 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:41.940528 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a84c9b8c-3900-409b-8ede-fbaaedfde162 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:41.945618 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-e80c0588-5f42-4bfa-954e-6ff804f100c1 req-e98105d3-53b2-4db3-b5e1-0d861002ccd9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060032 Jun 21 08:16:41.946220 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 94/195] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:41.962121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b7c19a7c-7318-4d2d-8317-16d3e1a86592 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:41.964971 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b7c19a7c-7318-4d2d-8317-16d3e1a86592 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:41.979370 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b7c19a7c-7318-4d2d-8317-16d3e1a86592 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:41.980220 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b7c19a7c-7318-4d2d-8317-16d3e1a86592 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:41.981742 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b7c19a7c-7318-4d2d-8317-16d3e1a86592 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:41.982353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b7c19a7c-7318-4d2d-8317-16d3e1a86592 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:42.042503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a84c9b8c-3900-409b-8ede-fbaaedfde162 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:42.052735 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a84c9b8c-3900-409b-8ede-fbaaedfde162 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1511 microversion: 2.1 time: 0.137552 Jun 21 08:16:42.061055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 102/196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:41 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1511 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:42.193416 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-bb0768d8-2b8a-41cc-968d-7eaf14f40068 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:42.194041 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-bb0768d8-2b8a-41cc-968d-7eaf14f40068 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:42.203702 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bb0768d8-2b8a-41cc-968d-7eaf14f40068 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:42.206794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bb0768d8-2b8a-41cc-968d-7eaf14f40068 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:42.208868 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bb0768d8-2b8a-41cc-968d-7eaf14f40068 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:42.212706 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bb0768d8-2b8a-41cc-968d-7eaf14f40068 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:42.507107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-bb0768d8-2b8a-41cc-968d-7eaf14f40068 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:42.518322 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-bb0768d8-2b8a-41cc-968d-7eaf14f40068 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1499 microversion: 2.1 time: 0.328798 Jun 21 08:16:42.532998 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 103/197] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:42 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1499 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:42.617655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b7c19a7c-7318-4d2d-8317-16d3e1a86592 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:42.638451 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b7c19a7c-7318-4d2d-8317-16d3e1a86592 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.680383 Jun 21 08:16:42.654785 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 95/198] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:41 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:42.869467 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ab2c0a87-dfdf-4f74-bef8-2a17ad67c54d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:42.870083 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ab2c0a87-dfdf-4f74-bef8-2a17ad67c54d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:42.878161 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ab2c0a87-dfdf-4f74-bef8-2a17ad67c54d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:42.878645 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ab2c0a87-dfdf-4f74-bef8-2a17ad67c54d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:42.880312 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ab2c0a87-dfdf-4f74-bef8-2a17ad67c54d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:42.880734 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ab2c0a87-dfdf-4f74-bef8-2a17ad67c54d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:42.949217 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ab2c0a87-dfdf-4f74-bef8-2a17ad67c54d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:42.959882 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ab2c0a87-dfdf-4f74-bef8-2a17ad67c54d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1273 microversion: 2.1 time: 0.094390 Jun 21 08:16:42.961084 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 104/199] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:42 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:43.029078 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-af8ed8c0-039b-46e6-8886-fd25671b4c3c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:43.029635 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-af8ed8c0-039b-46e6-8886-fd25671b4c3c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:43.043406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-af8ed8c0-039b-46e6-8886-fd25671b4c3c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:43.044186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-af8ed8c0-039b-46e6-8886-fd25671b4c3c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:43.045215 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-af8ed8c0-039b-46e6-8886-fd25671b4c3c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:43.045978 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-af8ed8c0-039b-46e6-8886-fd25671b4c3c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:43.071758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:43.072699 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:43.080668 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:43.081605 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:43.082567 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:43.083042 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:43.086532 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-af8ed8c0-039b-46e6-8886-fd25671b4c3c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:16:43.123252 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:43.162097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:43.162962 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:43.163597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lazy-loading 'fault' on Instance uuid a986f1a9-57eb-4763-9487-8312fb029ae9 {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:16:43.230393 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94ea4bbf414d2d89cfe3c232f2a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:43.241371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8ebee896-5c1c-4819-96bd-24a7b26f375b tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 200 len: 1350 microversion: 2.1 time: 0.174584 Jun 21 08:16:43.242734 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 105/200] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:43 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 1350 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:43.253576 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-af8ed8c0-039b-46e6-8886-fd25671b4c3c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 204 len: 0 microversion: 2.1 time: 0.230253 Jun 21 08:16:43.254936 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 96/201] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:16:43 2022] DELETE /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:16:43.264367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0cf9aa42-8104-4a9d-b2b2-d720e98618f1 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:43.265323 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0cf9aa42-8104-4a9d-b2b2-d720e98618f1 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:43.281406 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0cf9aa42-8104-4a9d-b2b2-d720e98618f1 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:43.281962 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0cf9aa42-8104-4a9d-b2b2-d720e98618f1 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:43.284095 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0cf9aa42-8104-4a9d-b2b2-d720e98618f1 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:43.286035 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0cf9aa42-8104-4a9d-b2b2-d720e98618f1 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:43.528941 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0cf9aa42-8104-4a9d-b2b2-d720e98618f1 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:43.540450 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0cf9aa42-8104-4a9d-b2b2-d720e98618f1 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1505 microversion: 2.1 time: 0.281183 Jun 21 08:16:43.544091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 106/202] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:43 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:43.663713 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-42064f0c-fd6a-4034-a44a-9f2a7b5ecae7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:43.664818 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-42064f0c-fd6a-4034-a44a-9f2a7b5ecae7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:43.673335 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42064f0c-fd6a-4034-a44a-9f2a7b5ecae7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:43.673897 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42064f0c-fd6a-4034-a44a-9f2a7b5ecae7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:43.674730 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42064f0c-fd6a-4034-a44a-9f2a7b5ecae7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:43.675352 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42064f0c-fd6a-4034-a44a-9f2a7b5ecae7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:43.908935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-42064f0c-fd6a-4034-a44a-9f2a7b5ecae7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:43.918894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-42064f0c-fd6a-4034-a44a-9f2a7b5ecae7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.261196 Jun 21 08:16:43.919486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 97/203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:43 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:43.978410 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-283e1e4f-1ed2-402f-b4bd-9468a027996a tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:43.979262 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-283e1e4f-1ed2-402f-b4bd-9468a027996a tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:43.994449 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-283e1e4f-1ed2-402f-b4bd-9468a027996a tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:43.995687 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-283e1e4f-1ed2-402f-b4bd-9468a027996a tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:43.997432 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-283e1e4f-1ed2-402f-b4bd-9468a027996a tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:44.001444 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-283e1e4f-1ed2-402f-b4bd-9468a027996a tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:44.242197 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-283e1e4f-1ed2-402f-b4bd-9468a027996a tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:44.256458 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-283e1e4f-1ed2-402f-b4bd-9468a027996a tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1315 microversion: 2.1 time: 0.282265 Jun 21 08:16:44.257401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 107/204] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:43 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:44.263345 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6b2be0f1-67ec-4831-886f-c197fa3f6367 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:44.264220 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6b2be0f1-67ec-4831-886f-c197fa3f6367 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:44.272755 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6b2be0f1-67ec-4831-886f-c197fa3f6367 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:44.273209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6b2be0f1-67ec-4831-886f-c197fa3f6367 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:44.274015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6b2be0f1-67ec-4831-886f-c197fa3f6367 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:44.274454 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6b2be0f1-67ec-4831-886f-c197fa3f6367 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:44.292938 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-6b2be0f1-67ec-4831-886f-c197fa3f6367 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] HTTP exception thrown: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6b2be0f1-67ec-4831-886f-c197fa3f6367 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Request method failure captured: Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 HTTP/1.1 Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4j7QbxQxuDdXiF7znxL6gA0pZJZBbQQo3EQ2DBBk0W-VIu2m-R53ZkJ-MAW847Pk77gmydsKg3efrrNpAuz_y2d0-_uOCp6xrc-BjiB0ElJrpgDKBuFI8CA47H7C6V-PCKmy5Tyyr4kRL-AIsPKrqUtZrRSxvhM0fSVpFL67Ex7Jw Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 6f60bd09c67c4a3ba0f96d5367a3cd76 Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:16:44.298880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f60bd09c67c4a3ba0f96d5367a3cd76", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 6f60bd09c67c4a3ba0f96d5367a3cd76 Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-DeleteServersTestJSON-749711396-project Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: cf94ea4bbf414d2d89cfe3c232f2a54b Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-DeleteServersTestJSON-749711396-project Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:44.300090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'a986f1a9-57eb-4763-9487-8312fb029ae9'} Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:44.300867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:44.301952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:44.303827 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6b2be0f1-67ec-4831-886f-c197fa3f6367 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Returning 404 to user: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:44.305752 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6b2be0f1-67ec-4831-886f-c197fa3f6367 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 404 len: 111 microversion: 2.1 time: 0.047711 Jun 21 08:16:44.306940 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 98/205] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:44 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 08:16:44.434820 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7caf08d7-fb60-4332-9e35-43a56f2762e5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:44.435857 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7caf08d7-fb60-4332-9e35-43a56f2762e5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:44.443092 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7caf08d7-fb60-4332-9e35-43a56f2762e5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:44.443654 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7caf08d7-fb60-4332-9e35-43a56f2762e5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:44.444478 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7caf08d7-fb60-4332-9e35-43a56f2762e5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:44.445068 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7caf08d7-fb60-4332-9e35-43a56f2762e5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:44.460585 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-7caf08d7-fb60-4332-9e35-43a56f2762e5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] HTTP exception thrown: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7caf08d7-fb60-4332-9e35-43a56f2762e5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Request method failure captured: Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9/os-volume_attachments HTTP/1.1 Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX4j7QbxQxuDdXiF7znxL6gA0pZJZBbQQo3EQ2DBBk0W-VIu2m-R53ZkJ-MAW847Pk77gmydsKg3efrrNpAuz_y2d0-_uOCp6xrc-BjiB0ElJrpgDKBuFI8CA47H7C6V-PCKmy5Tyyr4kRL-AIsPKrqUtZrRSxvhM0fSVpFL67Ex7Jw Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 6f60bd09c67c4a3ba0f96d5367a3cd76 Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:16:44.466045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f60bd09c67c4a3ba0f96d5367a3cd76", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 6f60bd09c67c4a3ba0f96d5367a3cd76 Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-DeleteServersTestJSON-749711396-project Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: cf94ea4bbf414d2d89cfe3c232f2a54b Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-DeleteServersTestJSON-749711396-project Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:44.467313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'server_id': 'a986f1a9-57eb-4763-9487-8312fb029ae9'} Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:44.468086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:44.469146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:44.470906 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7caf08d7-fb60-4332-9e35-43a56f2762e5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Returning 404 to user: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:44.470906 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7caf08d7-fb60-4332-9e35-43a56f2762e5 tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036683 Jun 21 08:16:44.470906 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 108/206] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:16:44 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:16:44.560097 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3fd09ff1-6ae6-4709-96c1-1d407b5b6161 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:44.560587 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3fd09ff1-6ae6-4709-96c1-1d407b5b6161 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:44.587850 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fd09ff1-6ae6-4709-96c1-1d407b5b6161 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:44.588295 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fd09ff1-6ae6-4709-96c1-1d407b5b6161 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:44.589059 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fd09ff1-6ae6-4709-96c1-1d407b5b6161 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:44.589489 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fd09ff1-6ae6-4709-96c1-1d407b5b6161 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:44.862683 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3fd09ff1-6ae6-4709-96c1-1d407b5b6161 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:44.877202 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3fd09ff1-6ae6-4709-96c1-1d407b5b6161 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1505 microversion: 2.1 time: 0.321081 Jun 21 08:16:44.878502 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 99/207] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:44 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:44.938301 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-84fff32e-7703-42d1-8ec7-6dc0af65d322 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:44.939087 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-84fff32e-7703-42d1-8ec7-6dc0af65d322 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:44.945652 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-84fff32e-7703-42d1-8ec7-6dc0af65d322 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:44.946184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-84fff32e-7703-42d1-8ec7-6dc0af65d322 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:44.946979 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-84fff32e-7703-42d1-8ec7-6dc0af65d322 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:44.947604 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-84fff32e-7703-42d1-8ec7-6dc0af65d322 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:45.106498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-84fff32e-7703-42d1-8ec7-6dc0af65d322 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:45.115496 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-84fff32e-7703-42d1-8ec7-6dc0af65d322 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.182309 Jun 21 08:16:45.116196 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 109/208] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:44 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:45.275386 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d6b77014-1559-4ae9-a792-2b76cb4d8bfe tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:45.276185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d6b77014-1559-4ae9-a792-2b76cb4d8bfe tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:45.288317 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d6b77014-1559-4ae9-a792-2b76cb4d8bfe tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:45.289115 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d6b77014-1559-4ae9-a792-2b76cb4d8bfe tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:45.291331 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d6b77014-1559-4ae9-a792-2b76cb4d8bfe tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:45.292453 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d6b77014-1559-4ae9-a792-2b76cb4d8bfe tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:45.604483 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d6b77014-1559-4ae9-a792-2b76cb4d8bfe tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:45.612873 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d6b77014-1559-4ae9-a792-2b76cb4d8bfe tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1315 microversion: 2.1 time: 0.343484 Jun 21 08:16:45.622452 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 100/209] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:45 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:45.699696 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-a43d4df9-1c68-4d65-b278-30b1a5143c41 req-50dd7374-e93c-4cc4-ae6f-3eca0d6fd6de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "249ade97-c85b-4b43-ad88-2c715fa26af4", "tag": "7f4d5eec-3ac5-46c7-8f98-30ea9229f7bf"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:45.728685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-a43d4df9-1c68-4d65-b278-30b1a5143c41 req-50dd7374-e93c-4cc4-ae6f-3eca0d6fd6de service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:45.730898 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-a43d4df9-1c68-4d65-b278-30b1a5143c41 req-50dd7374-e93c-4cc4-ae6f-3eca0d6fd6de service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:45.754209 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-a43d4df9-1c68-4d65-b278-30b1a5143c41 req-50dd7374-e93c-4cc4-ae6f-3eca0d6fd6de service nova] Creating event network-changed:7f4d5eec-3ac5-46c7-8f98-30ea9229f7bf for instance 249ade97-c85b-4b43-ad88-2c715fa26af4 on hv-cinder-83697 Jun 21 08:16:45.760381 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-a43d4df9-1c68-4d65-b278-30b1a5143c41 req-50dd7374-e93c-4cc4-ae6f-3eca0d6fd6de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068537 Jun 21 08:16:45.761511 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 110/210] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:45.781802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-767049ee-9113-4996-881c-99d22d1906bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:45.782346 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-767049ee-9113-4996-881c-99d22d1906bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:45.790021 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-767049ee-9113-4996-881c-99d22d1906bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:45.790460 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-767049ee-9113-4996-881c-99d22d1906bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:45.791254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-767049ee-9113-4996-881c-99d22d1906bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:45.791682 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-767049ee-9113-4996-881c-99d22d1906bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:45.810936 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-767049ee-9113-4996-881c-99d22d1906bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] HTTP exception thrown: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-767049ee-9113-4996-881c-99d22d1906bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Request method failure captured: Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: DELETE /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 HTTP/1.1 Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4j7QbxQxuDdXiF7znxL6gA0pZJZBbQQo3EQ2DBBk0W-VIu2m-R53ZkJ-MAW847Pk77gmydsKg3efrrNpAuz_y2d0-_uOCp6xrc-BjiB0ElJrpgDKBuFI8CA47H7C6V-PCKmy5Tyyr4kRL-AIsPKrqUtZrRSxvhM0fSVpFL67Ex7Jw Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 6f60bd09c67c4a3ba0f96d5367a3cd76 Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:16:45.812241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f60bd09c67c4a3ba0f96d5367a3cd76", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 6f60bd09c67c4a3ba0f96d5367a3cd76 Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-DeleteServersTestJSON-749711396-project Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: cf94ea4bbf414d2d89cfe3c232f2a54b Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-DeleteServersTestJSON-749711396-project Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:45.813789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'a986f1a9-57eb-4763-9487-8312fb029ae9'} Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:45.814596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:45.815820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:45.817080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-767049ee-9113-4996-881c-99d22d1906bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Returning 404 to user: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:45.817080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-767049ee-9113-4996-881c-99d22d1906bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 404 len: 111 microversion: 2.1 time: 0.040522 Jun 21 08:16:45.818779 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 101/211] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:16:45 2022] DELETE /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:16:45.825072 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e22fb9a8-4656-4b33-8319-ac390b8844bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:45.825779 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e22fb9a8-4656-4b33-8319-ac390b8844bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] [instance: a986f1a9-57eb-4763-9487-8312fb029ae9] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:45.832854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e22fb9a8-4656-4b33-8319-ac390b8844bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:45.833305 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e22fb9a8-4656-4b33-8319-ac390b8844bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:45.834259 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e22fb9a8-4656-4b33-8319-ac390b8844bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:45.834879 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e22fb9a8-4656-4b33-8319-ac390b8844bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:45.851352 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-e22fb9a8-4656-4b33-8319-ac390b8844bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] HTTP exception thrown: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e22fb9a8-4656-4b33-8319-ac390b8844bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Request method failure captured: Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 HTTP/1.1 Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX4j7QbxQxuDdXiF7znxL6gA0pZJZBbQQo3EQ2DBBk0W-VIu2m-R53ZkJ-MAW847Pk77gmydsKg3efrrNpAuz_y2d0-_uOCp6xrc-BjiB0ElJrpgDKBuFI8CA47H7C6V-PCKmy5Tyyr4kRL-AIsPKrqUtZrRSxvhM0fSVpFL67Ex7Jw Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 6f60bd09c67c4a3ba0f96d5367a3cd76 Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:16:45.854343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f60bd09c67c4a3ba0f96d5367a3cd76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f60bd09c67c4a3ba0f96d5367a3cd76", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 6f60bd09c67c4a3ba0f96d5367a3cd76 Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-DeleteServersTestJSON-749711396 Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-DeleteServersTestJSON-749711396-project Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: cf94ea4bbf414d2d89cfe3c232f2a54b Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-DeleteServersTestJSON-749711396-project Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:45.855732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'a986f1a9-57eb-4763-9487-8312fb029ae9'} Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:45.856532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. Jun 21 08:16:45.857974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:45.859977 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e22fb9a8-4656-4b33-8319-ac390b8844bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] Returning 404 to user: Instance a986f1a9-57eb-4763-9487-8312fb029ae9 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:45.859977 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e22fb9a8-4656-4b33-8319-ac390b8844bb tempest-DeleteServersTestJSON-749711396 tempest-DeleteServersTestJSON-749711396-project] 10.222.0.36 "GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9" status: 404 len: 111 microversion: 2.1 time: 0.038586 Jun 21 08:16:45.870703 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 111/212] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:45 2022] GET /compute/v2.1/servers/a986f1a9-57eb-4763-9487-8312fb029ae9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:16:45.903257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-86f0c218-4c56-467e-8be1-3fd40596ed03 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:45.904189 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-86f0c218-4c56-467e-8be1-3fd40596ed03 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:45.918879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-86f0c218-4c56-467e-8be1-3fd40596ed03 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:45.919335 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-86f0c218-4c56-467e-8be1-3fd40596ed03 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:45.921297 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-86f0c218-4c56-467e-8be1-3fd40596ed03 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:45.921747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-86f0c218-4c56-467e-8be1-3fd40596ed03 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:46.096616 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-86f0c218-4c56-467e-8be1-3fd40596ed03 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:46.106524 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-86f0c218-4c56-467e-8be1-3fd40596ed03 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 200 len: 1463 microversion: 2.1 time: 0.207898 Jun 21 08:16:46.118246 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 102/213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:45 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 1463 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:46.135583 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-482c533d-29a1-45c2-b1f6-7d13dfa921b9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:46.136518 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-482c533d-29a1-45c2-b1f6-7d13dfa921b9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:46.149187 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-482c533d-29a1-45c2-b1f6-7d13dfa921b9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:46.151328 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-482c533d-29a1-45c2-b1f6-7d13dfa921b9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:46.156946 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-482c533d-29a1-45c2-b1f6-7d13dfa921b9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:46.157370 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-482c533d-29a1-45c2-b1f6-7d13dfa921b9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:46.632994 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fe8bdb8f-f9d9-47ac-9919-cfa2669bc36e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:46.633923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-fe8bdb8f-f9d9-47ac-9919-cfa2669bc36e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:46.653651 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe8bdb8f-f9d9-47ac-9919-cfa2669bc36e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:46.655393 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe8bdb8f-f9d9-47ac-9919-cfa2669bc36e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:46.656437 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe8bdb8f-f9d9-47ac-9919-cfa2669bc36e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:46.658381 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe8bdb8f-f9d9-47ac-9919-cfa2669bc36e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:46.724951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-482c533d-29a1-45c2-b1f6-7d13dfa921b9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:46.738088 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-482c533d-29a1-45c2-b1f6-7d13dfa921b9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.607131 Jun 21 08:16:46.739340 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 112/214] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:46 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:46.956219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fe8bdb8f-f9d9-47ac-9919-cfa2669bc36e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:46.966116 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fe8bdb8f-f9d9-47ac-9919-cfa2669bc36e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1315 microversion: 2.1 time: 0.337812 Jun 21 08:16:46.966975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 103/215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:46 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:47.125236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0c385711-1fcb-4ab3-a1da-a7be89c35a5f tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:47.126426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0c385711-1fcb-4ab3-a1da-a7be89c35a5f tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: 1ea8d802-64a9-4160-b50d-daa8bee0c56d] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:47.128585 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:47.134980 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c385711-1fcb-4ab3-a1da-a7be89c35a5f tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:47.135431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c385711-1fcb-4ab3-a1da-a7be89c35a5f tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:47.136197 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c385711-1fcb-4ab3-a1da-a7be89c35a5f tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:47.136719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c385711-1fcb-4ab3-a1da-a7be89c35a5f tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:47.156081 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-0c385711-1fcb-4ab3-a1da-a7be89c35a5f tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] HTTP exception thrown: Instance 1ea8d802-64a9-4160-b50d-daa8bee0c56d could not be found. Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0c385711-1fcb-4ab3-a1da-a7be89c35a5f tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Request method failure captured: Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d HTTP/1.1 Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX5WX8iXcsnG-BPv7o5ZgEhAoSm_e4oKP-cp5fhhhloMRLQ77-sgagIooTn_rT5TYEkxURvdckAh8sSpJGxMZCGCsc79mJ4NEno7BB6QBCiFKWAEN2ciUBDULY5Eln7Ywymr_RxvwsXnFSjYbh5z8U6QE3sN1NnjeFBkuwFb5CpDHgc Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: d0ebfe281cb442e18830e44768082fdd Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-VolumesActionsTest-20242860 Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:16:47.157789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d0ebfe281cb442e18830e44768082fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d0ebfe281cb442e18830e44768082fdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d0ebfe281cb442e18830e44768082fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d0ebfe281cb442e18830e44768082fdd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-VolumesActionsTest-20242860 Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: d0ebfe281cb442e18830e44768082fdd Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-VolumesActionsTest-20242860 Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-VolumesActionsTest-20242860-project Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 48e816a85da046fbb8a02f9a84ecd6fb Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-VolumesActionsTest-20242860-project Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 1ea8d802-64a9-4160-b50d-daa8bee0c56d could not be found. Jun 21 08:16:47.159122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '1ea8d802-64a9-4160-b50d-daa8bee0c56d'} Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea8d802-64a9-4160-b50d-daa8bee0c56d could not be found. Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:47.160045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea8d802-64a9-4160-b50d-daa8bee0c56d could not be found. Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea8d802-64a9-4160-b50d-daa8bee0c56d could not be found. Jun 21 08:16:47.161091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:47.162916 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0c385711-1fcb-4ab3-a1da-a7be89c35a5f tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Returning 404 to user: Instance 1ea8d802-64a9-4160-b50d-daa8bee0c56d could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:47.164018 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0c385711-1fcb-4ab3-a1da-a7be89c35a5f tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d" status: 404 len: 111 microversion: 2.1 time: 0.042873 Jun 21 08:16:47.166663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 113/216] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:47 2022] GET /compute/v2.1/servers/1ea8d802-64a9-4160-b50d-daa8bee0c56d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:16:47.283816 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1856997108", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "networks": [{"uuid": "98d6b797-0aa0-4a78-a53e-fe3421f45339"}]}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:47.353606 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.network.neutron [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] validate_networks() for [('98d6b797-0aa0-4a78-a53e-fe3421f45339', None, None, None, None, None)] {{(pid=117548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:16:47.758266 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c8655e0a-7df8-4d65-9163-91667db4f37a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:47.759141 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c8655e0a-7df8-4d65-9163-91667db4f37a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:47.760432 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Flavor limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:16:47.760930 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Image limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:16:47.761307 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Flavor pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:16:47.761709 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Image pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:16:47.762849 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:16:47.766292 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c8655e0a-7df8-4d65-9163-91667db4f37a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:47.767356 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c8655e0a-7df8-4d65-9163-91667db4f37a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:47.768297 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c8655e0a-7df8-4d65-9163-91667db4f37a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:47.768896 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c8655e0a-7df8-4d65-9163-91667db4f37a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:47.792164 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:47.792602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:47.793664 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:47.794145 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:47.817740 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Getting quotas for project d0ebfe281cb442e18830e44768082fdd. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:16:47.821582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Getting quotas for user 48e816a85da046fbb8a02f9a84ecd6fb and project d0ebfe281cb442e18830e44768082fdd. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:16:47.832514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Going to run 1 instances... {{(pid=117548) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:16:47.834778 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:16:47.890517 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-512c2e60-c84b-4734-90c3-2a3aff6a493d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611109 Jun 21 08:16:47.892032 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 104/217] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:16:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:16:47.897141 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-af434a22-6641-4857-a25d-be139391fd6e req-6a787212-1a1c-416e-a33e-19337cee1bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea8d802-64a9-4160-b50d-daa8bee0c56d", "name": "network-vif-deleted", "tag": "90a66523-b3bd-4fd9-a1b9-e5917bcdbb1c"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:47.909762 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-af434a22-6641-4857-a25d-be139391fd6e req-6a787212-1a1c-416e-a33e-19337cee1bc5 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:47.910406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-af434a22-6641-4857-a25d-be139391fd6e req-6a787212-1a1c-416e-a33e-19337cee1bc5 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:47.924172 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-af434a22-6641-4857-a25d-be139391fd6e req-6a787212-1a1c-416e-a33e-19337cee1bc5 service nova] Creating event network-vif-deleted:90a66523-b3bd-4fd9-a1b9-e5917bcdbb1c for instance 1ea8d802-64a9-4160-b50d-daa8bee0c56d on hv-cinder-83697 Jun 21 08:16:47.933738 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-af434a22-6641-4857-a25d-be139391fd6e req-6a787212-1a1c-416e-a33e-19337cee1bc5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038619 Jun 21 08:16:47.935451 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 105/218] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:47.950570 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-56ab008e-ed20-446c-bc42-f21e3082a678 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:47.952245 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-56ab008e-ed20-446c-bc42-f21e3082a678 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:48.084503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-56ab008e-ed20-446c-bc42-f21e3082a678 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:48.096307 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-56ab008e-ed20-446c-bc42-f21e3082a678 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1214 microversion: 2.1 time: 0.159281 Jun 21 08:16:48.097141 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 106/219] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:47 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:48.113508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-049c7fc0-93e9-461e-9e9b-6f08bacd8180 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:48.114706 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-049c7fc0-93e9-461e-9e9b-6f08bacd8180 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:48.122331 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-049c7fc0-93e9-461e-9e9b-6f08bacd8180 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:48.123093 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-049c7fc0-93e9-461e-9e9b-6f08bacd8180 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:48.124337 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-049c7fc0-93e9-461e-9e9b-6f08bacd8180 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:48.124983 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-049c7fc0-93e9-461e-9e9b-6f08bacd8180 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:48.133848 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c8655e0a-7df8-4d65-9163-91667db4f37a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:48.142550 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c8655e0a-7df8-4d65-9163-91667db4f37a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.390080 Jun 21 08:16:48.143184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 114/220] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:47 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:48.388712 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-049c7fc0-93e9-461e-9e9b-6f08bacd8180 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:48.402559 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-049c7fc0-93e9-461e-9e9b-6f08bacd8180 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1315 microversion: 2.1 time: 0.293445 Jun 21 08:16:48.407642 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 107/221] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:48 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:49.113974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-bcfc56bd-44d1-4e25-b048-63468028a488 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:49.114740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-bcfc56bd-44d1-4e25-b048-63468028a488 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:49.124697 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bcfc56bd-44d1-4e25-b048-63468028a488 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:49.125823 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bcfc56bd-44d1-4e25-b048-63468028a488 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:49.127350 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bcfc56bd-44d1-4e25-b048-63468028a488 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:49.127944 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bcfc56bd-44d1-4e25-b048-63468028a488 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:49.159923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b94d57bf-73dc-4ced-bba5-6806c8cdfec9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:49.174512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b94d57bf-73dc-4ced-bba5-6806c8cdfec9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:49.178189 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b94d57bf-73dc-4ced-bba5-6806c8cdfec9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:49.178913 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b94d57bf-73dc-4ced-bba5-6806c8cdfec9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:49.179919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b94d57bf-73dc-4ced-bba5-6806c8cdfec9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:49.180537 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b94d57bf-73dc-4ced-bba5-6806c8cdfec9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:49.228932 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-bcfc56bd-44d1-4e25-b048-63468028a488 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:49.243828 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-bcfc56bd-44d1-4e25-b048-63468028a488 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1266 microversion: 2.1 time: 0.134044 Jun 21 08:16:49.245363 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 115/222] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:49 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:49.423532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5755888c-8bad-43a3-afd7-61f824fdf499 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:49.430463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5755888c-8bad-43a3-afd7-61f824fdf499 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:49.440159 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5755888c-8bad-43a3-afd7-61f824fdf499 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:49.440615 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5755888c-8bad-43a3-afd7-61f824fdf499 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:49.446965 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5755888c-8bad-43a3-afd7-61f824fdf499 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:49.447405 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5755888c-8bad-43a3-afd7-61f824fdf499 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:49.662938 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b94d57bf-73dc-4ced-bba5-6806c8cdfec9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:49.673800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b94d57bf-73dc-4ced-bba5-6806c8cdfec9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.517882 Jun 21 08:16:49.678468 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 108/223] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:49 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:49.889218 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5755888c-8bad-43a3-afd7-61f824fdf499 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:49.898666 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5755888c-8bad-43a3-afd7-61f824fdf499 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1315 microversion: 2.1 time: 0.481281 Jun 21 08:16:49.899313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 116/224] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:49 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:50.263950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-94485dab-8ed2-40c6-a943-68f4a368468c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:50.265164 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-94485dab-8ed2-40c6-a943-68f4a368468c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:50.287116 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-94485dab-8ed2-40c6-a943-68f4a368468c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:50.289935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-94485dab-8ed2-40c6-a943-68f4a368468c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:50.290829 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-94485dab-8ed2-40c6-a943-68f4a368468c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:50.291280 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-94485dab-8ed2-40c6-a943-68f4a368468c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:50.322507 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-87074ea0-d7d7-4c5a-bf58-00721c97d26c req-fa26e2c7-5b7b-496b-9962-511ff587d5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "249ade97-c85b-4b43-ad88-2c715fa26af4", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d5eec-3ac5-46c7-8f98-30ea9229f7bf"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:50.336967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-87074ea0-d7d7-4c5a-bf58-00721c97d26c req-fa26e2c7-5b7b-496b-9962-511ff587d5f3 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:50.337709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-87074ea0-d7d7-4c5a-bf58-00721c97d26c req-fa26e2c7-5b7b-496b-9962-511ff587d5f3 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:50.361325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-87074ea0-d7d7-4c5a-bf58-00721c97d26c req-fa26e2c7-5b7b-496b-9962-511ff587d5f3 service nova] Creating event network-vif-plugged:7f4d5eec-3ac5-46c7-8f98-30ea9229f7bf for instance 249ade97-c85b-4b43-ad88-2c715fa26af4 on hv-cinder-83697 Jun 21 08:16:50.373163 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-87074ea0-d7d7-4c5a-bf58-00721c97d26c req-fa26e2c7-5b7b-496b-9962-511ff587d5f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054354 Jun 21 08:16:50.377874 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 117/225] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:16:50.691848 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:50.692613 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=6 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:50.697211 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-93043566-c4a3-4a4b-a7c1-7cc0919fbadb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:50.697948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-93043566-c4a3-4a4b-a7c1-7cc0919fbadb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:50.715279 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-93043566-c4a3-4a4b-a7c1-7cc0919fbadb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:50.715732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-93043566-c4a3-4a4b-a7c1-7cc0919fbadb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:50.716527 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-93043566-c4a3-4a4b-a7c1-7cc0919fbadb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:50.716964 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-93043566-c4a3-4a4b-a7c1-7cc0919fbadb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:50.929400 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-94485dab-8ed2-40c6-a943-68f4a368468c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:50.939839 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-94485dab-8ed2-40c6-a943-68f4a368468c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1314 microversion: 2.1 time: 0.680275 Jun 21 08:16:50.940873 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 109/226] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:50 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:50.947185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8994e45b-4f0a-4606-a1d4-a4bb92d1ad40 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:50.947867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8994e45b-4f0a-4606-a1d4-a4bb92d1ad40 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:50.957203 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8994e45b-4f0a-4606-a1d4-a4bb92d1ad40 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:50.957636 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8994e45b-4f0a-4606-a1d4-a4bb92d1ad40 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:50.958449 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8994e45b-4f0a-4606-a1d4-a4bb92d1ad40 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:50.958950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8994e45b-4f0a-4606-a1d4-a4bb92d1ad40 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:51.100110 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-93043566-c4a3-4a4b-a7c1-7cc0919fbadb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:51.109414 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-93043566-c4a3-4a4b-a7c1-7cc0919fbadb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.418478 Jun 21 08:16:51.114348 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 118/227] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:50 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:51.255080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8994e45b-4f0a-4606-a1d4-a4bb92d1ad40 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:51.265842 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8994e45b-4f0a-4606-a1d4-a4bb92d1ad40 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1315 microversion: 2.1 time: 0.323061 Jun 21 08:16:51.267215 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 110/228] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:50 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:51.614747 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-78a5dc70-f8c2-4477-95a9-f87538819792 req-b3c5c7a8-0273-4900-bfd8-e4a7c5834eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb1b7185-d26e-4a65-9b25-9a4cdf59b52a", "tag": "4e320460-6ab7-482f-af30-5c7fb8b93b9f"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:51.623534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-78a5dc70-f8c2-4477-95a9-f87538819792 req-b3c5c7a8-0273-4900-bfd8-e4a7c5834eb3 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:51.624458 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-78a5dc70-f8c2-4477-95a9-f87538819792 req-b3c5c7a8-0273-4900-bfd8-e4a7c5834eb3 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:51.630750 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:51.639379 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-78a5dc70-f8c2-4477-95a9-f87538819792 req-b3c5c7a8-0273-4900-bfd8-e4a7c5834eb3 service nova] Creating event network-changed:4e320460-6ab7-482f-af30-5c7fb8b93b9f for instance eb1b7185-d26e-4a65-9b25-9a4cdf59b52a on hv-cinder-83697 Jun 21 08:16:51.645049 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-78a5dc70-f8c2-4477-95a9-f87538819792 req-b3c5c7a8-0273-4900-bfd8-e4a7c5834eb3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034131 Jun 21 08:16:51.645958 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 119/229] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:51.962108 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2367e719-19cd-42a1-b622-5f08bdb56bb0 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:51.962808 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2367e719-19cd-42a1-b622-5f08bdb56bb0 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:51.966894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:51.972629 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2367e719-19cd-42a1-b622-5f08bdb56bb0 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:51.973387 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2367e719-19cd-42a1-b622-5f08bdb56bb0 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:51.974304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2367e719-19cd-42a1-b622-5f08bdb56bb0 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:51.974940 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2367e719-19cd-42a1-b622-5f08bdb56bb0 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:52.134607 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-180696c4-cbb1-4591-96c0-c5434f66947d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:52.139609 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-180696c4-cbb1-4591-96c0-c5434f66947d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:52.151715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-180696c4-cbb1-4591-96c0-c5434f66947d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:52.152168 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-180696c4-cbb1-4591-96c0-c5434f66947d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:52.152969 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-180696c4-cbb1-4591-96c0-c5434f66947d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:52.153408 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-180696c4-cbb1-4591-96c0-c5434f66947d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:52.324459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2367e719-19cd-42a1-b622-5f08bdb56bb0 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:52.331174 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-180696c4-cbb1-4591-96c0-c5434f66947d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:52.347466 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2367e719-19cd-42a1-b622-5f08bdb56bb0 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1314 microversion: 2.1 time: 0.392072 Jun 21 08:16:52.356706 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 111/230] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:51 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:52.356970 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-180696c4-cbb1-4591-96c0-c5434f66947d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.225474 Jun 21 08:16:52.356970 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 120/231] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:52 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:52.371126 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-40e4f9f4-3e18-4b3b-9b26-92fc72546094 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:52.371737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-40e4f9f4-3e18-4b3b-9b26-92fc72546094 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:52.381117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-40e4f9f4-3e18-4b3b-9b26-92fc72546094 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:52.381627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-40e4f9f4-3e18-4b3b-9b26-92fc72546094 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:52.382399 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-40e4f9f4-3e18-4b3b-9b26-92fc72546094 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:52.382871 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-40e4f9f4-3e18-4b3b-9b26-92fc72546094 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:52.654293 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-40e4f9f4-3e18-4b3b-9b26-92fc72546094 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:52.672932 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-40e4f9f4-3e18-4b3b-9b26-92fc72546094 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1315 microversion: 2.1 time: 0.319140 Jun 21 08:16:52.697495 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 112/232] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:52 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:53.255060 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1cc1a748-5cc7-4b79-95c0-e4b0ceda5a79 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] Action: 'create', calling method: .version_select at 0x7fded80ec700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-361055018", "metadata": {"Type": "work"}}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:53.369503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d64987bc-5601-48d6-aa9d-4aa6bd349159 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:53.371618 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d64987bc-5601-48d6-aa9d-4aa6bd349159 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:53.378585 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d64987bc-5601-48d6-aa9d-4aa6bd349159 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:53.379358 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d64987bc-5601-48d6-aa9d-4aa6bd349159 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:53.380326 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d64987bc-5601-48d6-aa9d-4aa6bd349159 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:53.380967 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d64987bc-5601-48d6-aa9d-4aa6bd349159 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:53.591831 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d64987bc-5601-48d6-aa9d-4aa6bd349159 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:53.600435 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d64987bc-5601-48d6-aa9d-4aa6bd349159 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1314 microversion: 2.1 time: 0.239634 Jun 21 08:16:53.601930 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 113/233] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:53 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:53.607951 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d2380070-d42e-431f-97be-35830b96a90d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:53.608610 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d2380070-d42e-431f-97be-35830b96a90d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:53.616407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2380070-d42e-431f-97be-35830b96a90d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:53.616940 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2380070-d42e-431f-97be-35830b96a90d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:53.617799 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2380070-d42e-431f-97be-35830b96a90d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:53.618238 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2380070-d42e-431f-97be-35830b96a90d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:53.630728 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1cc1a748-5cc7-4b79-95c0-e4b0ceda5a79 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.684941 Jun 21 08:16:53.631588 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 121/234] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 21 08:16:52 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 687 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 08:16:53.646858 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ac10a711-8ae0-4afd-8b08-b4b1b579caf0 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] Calling method '.version_select at 0x7fded81f91f0>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:53.739833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ac10a711-8ae0-4afd-8b08-b4b1b579caf0 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2" status: 200 len: 352 microversion: 2.1 time: 0.101068 Jun 21 08:16:53.745237 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 122/235] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:16:53 2022] GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:16:53.751157 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4cfa4536-f195-47e6-bc1a-bb92fbc2e06e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:53.751913 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4cfa4536-f195-47e6-bc1a-bb92fbc2e06e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:53.758941 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4cfa4536-f195-47e6-bc1a-bb92fbc2e06e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:53.759387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4cfa4536-f195-47e6-bc1a-bb92fbc2e06e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:53.760144 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4cfa4536-f195-47e6-bc1a-bb92fbc2e06e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:53.760745 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4cfa4536-f195-47e6-bc1a-bb92fbc2e06e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:53.774134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d2380070-d42e-431f-97be-35830b96a90d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:53.782418 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d2380070-d42e-431f-97be-35830b96a90d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.178367 Jun 21 08:16:53.783117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 114/236] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:53 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:53.895979 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4cfa4536-f195-47e6-bc1a-bb92fbc2e06e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:53.904400 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4cfa4536-f195-47e6-bc1a-bb92fbc2e06e tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1465 microversion: 2.1 time: 0.158005 Jun 21 08:16:53.904990 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 123/237] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:53 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:53.944069 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-04c871dd-41f6-4e60-bac2-201f09acb9ad tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:53.944686 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-04c871dd-41f6-4e60-bac2-201f09acb9ad tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:53.950582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04c871dd-41f6-4e60-bac2-201f09acb9ad tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:53.951200 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04c871dd-41f6-4e60-bac2-201f09acb9ad tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:53.951959 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04c871dd-41f6-4e60-bac2-201f09acb9ad tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:53.952387 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04c871dd-41f6-4e60-bac2-201f09acb9ad tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:53.983274 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-04c871dd-41f6-4e60-bac2-201f09acb9ad tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:16:53.987696 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:54.081440 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-04c871dd-41f6-4e60-bac2-201f09acb9ad tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "DELETE /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 204 len: 0 microversion: 2.1 time: 0.141132 Jun 21 08:16:54.082275 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 115/238] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:16:53 2022] DELETE /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:16:54.091363 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3707f08a-e054-46ba-94c2-f56d11cc4893 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:54.092217 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3707f08a-e054-46ba-94c2-f56d11cc4893 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:54.099290 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3707f08a-e054-46ba-94c2-f56d11cc4893 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:54.099982 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3707f08a-e054-46ba-94c2-f56d11cc4893 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:54.101285 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3707f08a-e054-46ba-94c2-f56d11cc4893 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:54.102043 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3707f08a-e054-46ba-94c2-f56d11cc4893 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:54.335594 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-3707f08a-e054-46ba-94c2-f56d11cc4893 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:54.344997 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3707f08a-e054-46ba-94c2-f56d11cc4893 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1471 microversion: 2.1 time: 0.258550 Jun 21 08:16:54.345927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 124/239] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:54 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1471 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:54.618974 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8e67b1dd-78ca-4dc5-b070-bb223fcb95f7 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:54.620283 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8e67b1dd-78ca-4dc5-b070-bb223fcb95f7 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:54.628399 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8e67b1dd-78ca-4dc5-b070-bb223fcb95f7 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:54.628852 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8e67b1dd-78ca-4dc5-b070-bb223fcb95f7 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:54.630210 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8e67b1dd-78ca-4dc5-b070-bb223fcb95f7 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:54.630727 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8e67b1dd-78ca-4dc5-b070-bb223fcb95f7 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:54.753412 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-96c4680d-d607-4f6b-858c-aee520a35b1d tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] Calling method '.version_select at 0x7fded80ec670>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:54.772859 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8e67b1dd-78ca-4dc5-b070-bb223fcb95f7 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:54.783010 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8e67b1dd-78ca-4dc5-b070-bb223fcb95f7 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1314 microversion: 2.1 time: 0.168076 Jun 21 08:16:54.784137 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 116/240] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:54 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:54.800710 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-72dee98c-c646-4abd-b29d-5e0de8b05f50 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:54.801617 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-72dee98c-c646-4abd-b29d-5e0de8b05f50 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:54.810552 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-72dee98c-c646-4abd-b29d-5e0de8b05f50 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:54.811383 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-72dee98c-c646-4abd-b29d-5e0de8b05f50 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:54.812554 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-72dee98c-c646-4abd-b29d-5e0de8b05f50 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:54.813949 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-72dee98c-c646-4abd-b29d-5e0de8b05f50 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:54.815451 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-96c4680d-d607-4f6b-858c-aee520a35b1d tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2" status: 200 len: 353 microversion: 2.1 time: 0.066987 Jun 21 08:16:54.816449 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 125/241] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:16:54 2022] GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:54.828080 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f548d9ff-ab80-4240-9c4d-12a2d1e578a3 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] Calling method '.version_select at 0x7fded8347700>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:54.896828 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f548d9ff-ab80-4240-9c4d-12a2d1e578a3 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2" status: 200 len: 353 microversion: 2.1 time: 0.072140 Jun 21 08:16:54.897537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 126/242] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:16:54 2022] GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:54.912982 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3ad810ee-6689-4651-9081-d42d8cdb465c tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] Calling method '.version_select at 0x7fded8146e50>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:54.996513 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3ad810ee-6689-4651-9081-d42d8cdb465c tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2" status: 202 len: 0 microversion: 2.1 time: 0.089983 Jun 21 08:16:54.997487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 127/243] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 08:16:54 2022] DELETE /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:16:54.997777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-72dee98c-c646-4abd-b29d-5e0de8b05f50 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:55.007457 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4bb910ec-22c5-42de-bdf1-248f36a23d56 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] Calling method '.version_select at 0x7fded8146550>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:55.008667 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-72dee98c-c646-4abd-b29d-5e0de8b05f50 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.212639 Jun 21 08:16:55.009276 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 117/244] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:54 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:55.063994 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4bb910ec-22c5-42de-bdf1-248f36a23d56 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2" status: 200 len: 352 microversion: 2.1 time: 0.061048 Jun 21 08:16:55.064796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 128/245] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:16:55 2022] GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:16:55.362550 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5e0c6819-2321-47dc-8814-1b4b0be71c3d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:55.363205 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5e0c6819-2321-47dc-8814-1b4b0be71c3d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:55.369952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5e0c6819-2321-47dc-8814-1b4b0be71c3d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:55.370390 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5e0c6819-2321-47dc-8814-1b4b0be71c3d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:55.371360 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5e0c6819-2321-47dc-8814-1b4b0be71c3d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:55.372119 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5e0c6819-2321-47dc-8814-1b4b0be71c3d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:55.522713 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5e0c6819-2321-47dc-8814-1b4b0be71c3d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:55.532451 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5e0c6819-2321-47dc-8814-1b4b0be71c3d tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1471 microversion: 2.1 time: 0.173539 Jun 21 08:16:55.542148 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 118/246] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:55 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:55.801480 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c64ab612-454d-4071-aa24-f534709856ca tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:55.802154 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c64ab612-454d-4071-aa24-f534709856ca tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:55.808709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c64ab612-454d-4071-aa24-f534709856ca tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:55.809155 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c64ab612-454d-4071-aa24-f534709856ca tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:55.809919 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c64ab612-454d-4071-aa24-f534709856ca tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:55.810352 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c64ab612-454d-4071-aa24-f534709856ca tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:56.026805 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9269d1d2-c170-4b1b-a6fd-c4646df36f22 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:56.028192 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-9269d1d2-c170-4b1b-a6fd-c4646df36f22 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:56.030721 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c64ab612-454d-4071-aa24-f534709856ca tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:56.041100 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9269d1d2-c170-4b1b-a6fd-c4646df36f22 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:56.041844 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9269d1d2-c170-4b1b-a6fd-c4646df36f22 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:56.043989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9269d1d2-c170-4b1b-a6fd-c4646df36f22 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:56.045259 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9269d1d2-c170-4b1b-a6fd-c4646df36f22 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:56.063518 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c64ab612-454d-4071-aa24-f534709856ca tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1314 microversion: 2.1 time: 0.266792 Jun 21 08:16:56.075951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 129/247] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:55 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:56.089723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7d8e942b-4db8-4753-8506-1f93cc950091 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] Calling method '.version_select at 0x7fded80ecc10>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:56.148273 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-7d8e942b-4db8-4753-8506-1f93cc950091 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] HTTP exception thrown: Volume 06f817d6-bc5b-4a4f-b53f-778fd9277cd2 could not be found. Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7d8e942b-4db8-4753-8506-1f93cc950091 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] Request method failure captured: Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2 HTTP/1.1 Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX50wU8CUywYCKfAdb2V3XWBxYg_UmdRguDyiM6fWg06wZYkBWFdJUd6SjlT2gnVCempC4mu4y79iya3DIJ8jwJ2S961Y83IbCY3rW1VP-1-BcuE46ah5eLA9wOZUBzbvz8a0lKEtJkrxZngPGbHztdoHFuV4fOLhFOVraT_6QXGGFs Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 8eb5b190f1b0422b96dcda6d2a08abdc Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-VolumesGetTestJSON-1061541162 Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:16:56.152676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8eb5b190f1b0422b96dcda6d2a08abdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8eb5b190f1b0422b96dcda6d2a08abdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8eb5b190f1b0422b96dcda6d2a08abdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8eb5b190f1b0422b96dcda6d2a08abdc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-VolumesGetTestJSON-1061541162 Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 8eb5b190f1b0422b96dcda6d2a08abdc Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-VolumesGetTestJSON-1061541162 Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-VolumesGetTestJSON-1061541162-project Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 82f18e244efa4f139f88a232180f850c Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-VolumesGetTestJSON-1061541162-project Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Volume 06f817d6-bc5b-4a4f-b53f-778fd9277cd2 could not be found. Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '06f817d6-bc5b-4a4f-b53f-778fd9277cd2'} Jun 21 08:16:56.153877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06f817d6-bc5b-4a4f-b53f-778fd9277cd2 could not be found. (HTTP 404) (Request-ID: req-087ceea7-78c4-4826-87b9-54fe5cf25bfb) Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:56.154597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 08:16:56.155636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06f817d6-bc5b-4a4f-b53f-778fd9277cd2 could not be found. Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 08:16:56.157280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06f817d6-bc5b-4a4f-b53f-778fd9277cd2 could not be found. Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06f817d6-bc5b-4a4f-b53f-778fd9277cd2 could not be found. Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7d8e942b-4db8-4753-8506-1f93cc950091 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] Returning 404 to user: Volume 06f817d6-bc5b-4a4f-b53f-778fd9277cd2 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7d8e942b-4db8-4753-8506-1f93cc950091 tempest-VolumesGetTestJSON-1061541162 tempest-VolumesGetTestJSON-1061541162-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2" status: 404 len: 109 microversion: 2.1 time: 0.076355 Jun 21 08:16:56.158367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 130/248] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:16:56 2022] GET /compute/v2.1/os-volumes/06f817d6-bc5b-4a4f-b53f-778fd9277cd2 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:16:56.312494 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-9269d1d2-c170-4b1b-a6fd-c4646df36f22 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:56.324166 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9269d1d2-c170-4b1b-a6fd-c4646df36f22 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.300857 Jun 21 08:16:56.325111 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 119/249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:56 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:56.551810 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-96431aeb-d6dd-4a71-861e-1c26b867ad48 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:56.552602 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-96431aeb-d6dd-4a71-861e-1c26b867ad48 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:56.560650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-96431aeb-d6dd-4a71-861e-1c26b867ad48 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:56.561492 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-96431aeb-d6dd-4a71-861e-1c26b867ad48 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:56.562564 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-96431aeb-d6dd-4a71-861e-1c26b867ad48 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:56.563341 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-96431aeb-d6dd-4a71-861e-1c26b867ad48 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:56.782414 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-96431aeb-d6dd-4a71-861e-1c26b867ad48 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:56.815124 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-96431aeb-d6dd-4a71-861e-1c26b867ad48 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1471 microversion: 2.1 time: 0.267671 Jun 21 08:16:56.818809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 131/250] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:56 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:57.082180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-886ece68-e55b-4baf-ad6e-c46d5ec74aa3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:57.082984 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-886ece68-e55b-4baf-ad6e-c46d5ec74aa3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:57.096141 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-886ece68-e55b-4baf-ad6e-c46d5ec74aa3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:57.097615 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-886ece68-e55b-4baf-ad6e-c46d5ec74aa3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:57.098411 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-886ece68-e55b-4baf-ad6e-c46d5ec74aa3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:57.101940 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-886ece68-e55b-4baf-ad6e-c46d5ec74aa3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:57.182756 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-906f8512-3941-403d-8b16-56f81ce27c5d req-df1e569b-c6b8-4615-a7a8-b98ebccdc5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "249ade97-c85b-4b43-ad88-2c715fa26af4", "name": "network-vif-deleted", "tag": "7f4d5eec-3ac5-46c7-8f98-30ea9229f7bf"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:57.232097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-906f8512-3941-403d-8b16-56f81ce27c5d req-df1e569b-c6b8-4615-a7a8-b98ebccdc5ac service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:57.232822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-906f8512-3941-403d-8b16-56f81ce27c5d req-df1e569b-c6b8-4615-a7a8-b98ebccdc5ac service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:57.268990 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-906f8512-3941-403d-8b16-56f81ce27c5d req-df1e569b-c6b8-4615-a7a8-b98ebccdc5ac service nova] Creating event network-vif-deleted:7f4d5eec-3ac5-46c7-8f98-30ea9229f7bf for instance 249ade97-c85b-4b43-ad88-2c715fa26af4 on hv-cinder-83697 Jun 21 08:16:57.282977 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-906f8512-3941-403d-8b16-56f81ce27c5d req-df1e569b-c6b8-4615-a7a8-b98ebccdc5ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109663 Jun 21 08:16:57.288314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 132/251] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:16:57.350687 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8b8e69dc-5d2f-47a2-9bc9-15a473b7bc43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:57.351706 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8b8e69dc-5d2f-47a2-9bc9-15a473b7bc43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:57.363007 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8b8e69dc-5d2f-47a2-9bc9-15a473b7bc43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:57.368416 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8b8e69dc-5d2f-47a2-9bc9-15a473b7bc43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:57.370175 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8b8e69dc-5d2f-47a2-9bc9-15a473b7bc43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:57.372854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8b8e69dc-5d2f-47a2-9bc9-15a473b7bc43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:57.436646 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-886ece68-e55b-4baf-ad6e-c46d5ec74aa3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:57.449076 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-886ece68-e55b-4baf-ad6e-c46d5ec74aa3 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1314 microversion: 2.1 time: 0.371545 Jun 21 08:16:57.452223 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 120/252] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:57 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:57.838808 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:57.839868 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:57.843644 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:57.856699 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:57.860631 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:57.862740 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:57.865681 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:57.926039 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:57.926701 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:57.927456 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lazy-loading 'fault' on Instance uuid 249ade97-c85b-4b43-ad88-2c715fa26af4 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:16:58.012029 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8b8e69dc-5d2f-47a2-9bc9-15a473b7bc43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:58.022777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd2d93a30444c8fa6de094160f0ad97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791fbed0800400290c38ac5f481ec60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:58.034076 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-68bca4f2-d59d-4c92-a956-a9add8b5ed7b tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 200 len: 1305 microversion: 2.1 time: 0.199754 Jun 21 08:16:58.044093 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 121/253] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:57 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 1305 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:58.046234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8b8e69dc-5d2f-47a2-9bc9-15a473b7bc43 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.705487 Jun 21 08:16:58.047075 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 133/254] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:57 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:16:58.421512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-61af1cd9-f579-4856-890f-2cfe4f1d9ac6 req-065efef3-7024-4bc5-b9e5-4743ce32ca12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1b7185-d26e-4a65-9b25-9a4cdf59b52a", "name": "network-vif-plugged", "status": "completed", "tag": "4e320460-6ab7-482f-af30-5c7fb8b93b9f"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:58.425705 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=10 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:58.441675 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-61af1cd9-f579-4856-890f-2cfe4f1d9ac6 req-065efef3-7024-4bc5-b9e5-4743ce32ca12 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:58.442122 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-61af1cd9-f579-4856-890f-2cfe4f1d9ac6 req-065efef3-7024-4bc5-b9e5-4743ce32ca12 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:58.468071 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-61af1cd9-f579-4856-890f-2cfe4f1d9ac6 req-065efef3-7024-4bc5-b9e5-4743ce32ca12 service nova] Creating event network-vif-plugged:4e320460-6ab7-482f-af30-5c7fb8b93b9f for instance eb1b7185-d26e-4a65-9b25-9a4cdf59b52a on hv-cinder-83697 Jun 21 08:16:58.486378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c9ba0f8e-fdec-4f57-b7ac-376cad1d8e42 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:58.487449 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c9ba0f8e-fdec-4f57-b7ac-376cad1d8e42 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:58.509940 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c9ba0f8e-fdec-4f57-b7ac-376cad1d8e42 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:58.515063 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-61af1cd9-f579-4856-890f-2cfe4f1d9ac6 req-065efef3-7024-4bc5-b9e5-4743ce32ca12 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094629 Jun 21 08:16:58.518690 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 122/255] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:16:58.537419 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c9ba0f8e-fdec-4f57-b7ac-376cad1d8e42 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:58.544819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c9ba0f8e-fdec-4f57-b7ac-376cad1d8e42 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:58.553637 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c9ba0f8e-fdec-4f57-b7ac-376cad1d8e42 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:59.029845 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c9ba0f8e-fdec-4f57-b7ac-376cad1d8e42 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:59.039272 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c9ba0f8e-fdec-4f57-b7ac-376cad1d8e42 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1314 microversion: 2.1 time: 0.563074 Jun 21 08:16:59.040377 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 134/256] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:58 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:59.053460 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-209568eb-a1ac-441d-beec-d28a27f55887 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:59.054744 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-209568eb-a1ac-441d-beec-d28a27f55887 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] [instance: 249ade97-c85b-4b43-ad88-2c715fa26af4] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:59.070829 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-44c6c4b9-0ae8-4dd7-a9d8-8c75094a4e74 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:59.071320 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-44c6c4b9-0ae8-4dd7-a9d8-8c75094a4e74 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:16:59.079160 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-44c6c4b9-0ae8-4dd7-a9d8-8c75094a4e74 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:59.079886 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-44c6c4b9-0ae8-4dd7-a9d8-8c75094a4e74 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:59.080679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-44c6c4b9-0ae8-4dd7-a9d8-8c75094a4e74 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:59.081116 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-44c6c4b9-0ae8-4dd7-a9d8-8c75094a4e74 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:59.083823 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-209568eb-a1ac-441d-beec-d28a27f55887 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:59.084286 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-209568eb-a1ac-441d-beec-d28a27f55887 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:59.089995 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-209568eb-a1ac-441d-beec-d28a27f55887 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:16:59.090513 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-209568eb-a1ac-441d-beec-d28a27f55887 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:16:59.111814 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-209568eb-a1ac-441d-beec-d28a27f55887 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] HTTP exception thrown: Instance 249ade97-c85b-4b43-ad88-2c715fa26af4 could not be found. Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-209568eb-a1ac-441d-beec-d28a27f55887 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Request method failure captured: Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 HTTP/1.1 Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX5mdaOUKJi8wN4Uv0J0UisYUaGWeJxUGk-DGSOZOo_b_LACwKpdg3_NJ4v0GfiMW2ru_cULfWmYBaLFLA5ZOPpt_tcFqFfhfSixRNWxTMrtY0wTwm8nxYGK90ADVhS8aXkxjjxYlcRd51B3EGlN2EE3mJAvG4WfVy0_y-Rcnb0tq84 Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: b791fbed0800400290c38ac5f481ec60 Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-VolumesNegativeTest-1700717150 Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:16:59.114219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b791fbed0800400290c38ac5f481ec60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b791fbed0800400290c38ac5f481ec60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b791fbed0800400290c38ac5f481ec60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b791fbed0800400290c38ac5f481ec60", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-VolumesNegativeTest-1700717150 Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: b791fbed0800400290c38ac5f481ec60 Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-VolumesNegativeTest-1700717150 Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-VolumesNegativeTest-1700717150-project Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 4bd2d93a30444c8fa6de094160f0ad97 Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-VolumesNegativeTest-1700717150-project Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 249ade97-c85b-4b43-ad88-2c715fa26af4 could not be found. Jun 21 08:16:59.116582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '249ade97-c85b-4b43-ad88-2c715fa26af4'} Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 249ade97-c85b-4b43-ad88-2c715fa26af4 could not be found. Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:59.117492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 249ade97-c85b-4b43-ad88-2c715fa26af4 could not be found. Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 249ade97-c85b-4b43-ad88-2c715fa26af4 could not be found. Jun 21 08:16:59.119174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.123702 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-209568eb-a1ac-441d-beec-d28a27f55887 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] Returning 404 to user: Instance 249ade97-c85b-4b43-ad88-2c715fa26af4 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:59.135252 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-209568eb-a1ac-441d-beec-d28a27f55887 tempest-VolumesNegativeTest-1700717150 tempest-VolumesNegativeTest-1700717150-project] 10.222.0.36 "GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4" status: 404 len: 111 microversion: 2.1 time: 0.088366 Jun 21 08:16:59.142977 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 123/257] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:59 2022] GET /compute/v2.1/servers/249ade97-c85b-4b43-ad88-2c715fa26af4 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:16:59.417941 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-44c6c4b9-0ae8-4dd7-a9d8-8c75094a4e74 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:16:59.433803 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-44c6c4b9-0ae8-4dd7-a9d8-8c75094a4e74 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.373979 Jun 21 08:16:59.434419 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 135/258] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:16:59 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:16:59.570832 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e33629dd-4e7a-4a76-9781-bf309a96fd06 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Action: 'create', calling method: .version_select at 0x7fded803b160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1315871352", "metadata": {"Type": "work"}}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e33629dd-4e7a-4a76-9781-bf309a96fd06 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Request method failure captured: Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 122 Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX57sWJUiz1R99496GVUHQBu4n3hS3dRp00jZu_JQVhHMb0aSqz6CQzuF8emWoxRQcxfnL1V8lYCYnirU9Dp6eNMU8sRp7uPy9l6V0lU4ixBv4A-iXb1En7TFye_hSA_H_vkr2lnfzj312FmzKPZRe60lvUaDe75ITVIPBkQMF6Vg2g Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:16:59.590300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8daefbd914cc45a58999c6334c4e526f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 260fa9798af6456087bb20bff53b9192 Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1315871352", "metadata": {"Type": "work"}}} Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: Jun 21 08:16:59.591919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1315871352', 'metadata': {'Type': 'work'}}}} Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise error Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi '#$%' Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:59.593185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 08:16:59.595657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 08:16:59.596732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 08:16:59.596732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.596732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e33629dd-4e7a-4a76-9781-bf309a96fd06 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:59.596732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e33629dd-4e7a-4a76-9781-bf309a96fd06 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.183753 Jun 21 08:16:59.596732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 124/259] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 21 08:16:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 21 08:16:59.602332 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-13854ebf-d97c-4f8e-b7fe-5351317c5cc0 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Action: 'create', calling method: .version_select at 0x7fded80ec430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1137462447", "metadata": {"Type": "work"}}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-13854ebf-d97c-4f8e-b7fe-5351317c5cc0 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Request method failure captured: Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 120 Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX57sWJUiz1R99496GVUHQBu4n3hS3dRp00jZu_JQVhHMb0aSqz6CQzuF8emWoxRQcxfnL1V8lYCYnirU9Dp6eNMU8sRp7uPy9l6V0lU4ixBv4A-iXb1En7TFye_hSA_H_vkr2lnfzj312FmzKPZRe60lvUaDe75ITVIPBkQMF6Vg2g Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:16:59.605693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8daefbd914cc45a58999c6334c4e526f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 260fa9798af6456087bb20bff53b9192 Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1137462447", "metadata": {"Type": "work"}}} Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: Jun 21 08:16:59.607195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1137462447', 'metadata': {'Type': 'work'}}}} Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise error Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi '0' Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:59.608149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 08:16:59.609653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 08:16:59.611433 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 08:16:59.611433 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.611433 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-13854ebf-d97c-4f8e-b7fe-5351317c5cc0 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:59.614091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-13854ebf-d97c-4f8e-b7fe-5351317c5cc0 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008456 Jun 21 08:16:59.618826 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 136/260] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 21 08:16:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 08:16:59.624922 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a7040082-123d-4e07-b032-03cfb837a042 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Action: 'create', calling method: .version_select at 0x7fded8244b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1755901952", "metadata": {"Type": "work"}}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a7040082-123d-4e07-b032-03cfb837a042 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Request method failure captured: Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 119 Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX57sWJUiz1R99496GVUHQBu4n3hS3dRp00jZu_JQVhHMb0aSqz6CQzuF8emWoxRQcxfnL1V8lYCYnirU9Dp6eNMU8sRp7uPy9l6V0lU4ixBv4A-iXb1En7TFye_hSA_H_vkr2lnfzj312FmzKPZRe60lvUaDe75ITVIPBkQMF6Vg2g Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:16:59.633612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8daefbd914cc45a58999c6334c4e526f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 260fa9798af6456087bb20bff53b9192 Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1755901952", "metadata": {"Type": "work"}}} Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: Jun 21 08:16:59.634992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1755901952', 'metadata': {'Type': 'work'}}}} Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise error Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi '' Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:59.635717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 08:16:59.636894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 08:16:59.638073 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 08:16:59.638073 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.638073 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a7040082-123d-4e07-b032-03cfb837a042 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:59.638073 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a7040082-123d-4e07-b032-03cfb837a042 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015193 Jun 21 08:16:59.638073 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 125/261] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 21 08:16:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 08:16:59.646905 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-350f6183-1e9b-46fb-895a-e429c4f43d36 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Calling method '.version_select at 0x7fded8347af0>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:59.686771 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-350f6183-1e9b-46fb-895a-e429c4f43d36 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] HTTP exception thrown: Volume tempest-invalid-506933306 could not be found. Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-350f6183-1e9b-46fb-895a-e429c4f43d36 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Request method failure captured: Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-506933306 HTTP/1.1 Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX57sWJUiz1R99496GVUHQBu4n3hS3dRp00jZu_JQVhHMb0aSqz6CQzuF8emWoxRQcxfnL1V8lYCYnirU9Dp6eNMU8sRp7uPy9l6V0lU4ixBv4A-iXb1En7TFye_hSA_H_vkr2lnfzj312FmzKPZRe60lvUaDe75ITVIPBkQMF6Vg2g Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:16:59.690391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8daefbd914cc45a58999c6334c4e526f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 260fa9798af6456087bb20bff53b9192 Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Volume tempest-invalid-506933306 could not be found. Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'tempest-invalid-506933306'} Jun 21 08:16:59.691676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-506933306 could not be found. (HTTP 404) (Request-ID: req-039c3daf-2d28-4097-be0e-982aefcc8017) Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.692426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 08:16:59.693537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-506933306 could not be found. Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:16:59.694547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-506933306 could not be found. Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-506933306 could not be found. Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-350f6183-1e9b-46fb-895a-e429c4f43d36 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Returning 404 to user: Volume tempest-invalid-506933306 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-350f6183-1e9b-46fb-895a-e429c4f43d36 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-506933306" status: 404 len: 98 microversion: 2.1 time: 0.049381 Jun 21 08:16:59.697368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 137/262] 10.222.0.36 () {58 vars in 1214 bytes} [Tue Jun 21 08:16:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-506933306 => generated 98 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 21 08:16:59.704071 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e818e808-5c43-4e75-866b-f9e146f5707c tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004392 Jun 21 08:16:59.705510 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 126/263] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Jun 21 08:16:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 21 08:16:59.716345 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d320e953-f800-4d03-a23a-0db751af903c tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005602 Jun 21 08:16:59.721776 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 138/264] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Jun 21 08:16:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 08:16:59.729242 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1d59af8e-55d1-4571-b82d-d3392c399f51 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Calling method '.version_select at 0x7fded837a160>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:59.764770 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-1d59af8e-55d1-4571-b82d-d3392c399f51 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] HTTP exception thrown: Volume 0561747e-4da3-4f4a-9741-e742a2cad44b could not be found. Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1d59af8e-55d1-4571-b82d-d3392c399f51 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Request method failure captured: Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: DELETE /compute/v2.1/os-volumes/0561747e-4da3-4f4a-9741-e742a2cad44b HTTP/1.1 Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX57sWJUiz1R99496GVUHQBu4n3hS3dRp00jZu_JQVhHMb0aSqz6CQzuF8emWoxRQcxfnL1V8lYCYnirU9Dp6eNMU8sRp7uPy9l6V0lU4ixBv4A-iXb1En7TFye_hSA_H_vkr2lnfzj312FmzKPZRe60lvUaDe75ITVIPBkQMF6Vg2g Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:16:59.770492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8daefbd914cc45a58999c6334c4e526f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 260fa9798af6456087bb20bff53b9192 Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Volume 0561747e-4da3-4f4a-9741-e742a2cad44b could not be found. Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '0561747e-4da3-4f4a-9741-e742a2cad44b'} Jun 21 08:16:59.771944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0561747e-4da3-4f4a-9741-e742a2cad44b could not be found. (HTTP 404) (Request-ID: req-10778fbf-a3d1-4dd9-945e-4fef32f6a2f6) Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.772923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 08:16:59.778180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0561747e-4da3-4f4a-9741-e742a2cad44b could not be found. Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 08:16:59.779262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0561747e-4da3-4f4a-9741-e742a2cad44b could not be found. Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0561747e-4da3-4f4a-9741-e742a2cad44b could not be found. Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1d59af8e-55d1-4571-b82d-d3392c399f51 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Returning 404 to user: Volume 0561747e-4da3-4f4a-9741-e742a2cad44b could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1d59af8e-55d1-4571-b82d-d3392c399f51 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/0561747e-4da3-4f4a-9741-e742a2cad44b" status: 404 len: 109 microversion: 2.1 time: 0.048954 Jun 21 08:16:59.780291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 127/265] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 08:16:59 2022] DELETE /compute/v2.1/os-volumes/0561747e-4da3-4f4a-9741-e742a2cad44b => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:16:59.786421 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a45e9ece-d3a2-4f90-993d-c0185029e793 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Calling method '.version_select at 0x7fded8347550>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:16:59.828117 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-a45e9ece-d3a2-4f90-993d-c0185029e793 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] HTTP exception thrown: Volume e6a16b03-300f-4939-baf7-436f545ef5ee could not be found. Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a45e9ece-d3a2-4f90-993d-c0185029e793 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Request method failure captured: Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/os-volumes/e6a16b03-300f-4939-baf7-436f545ef5ee HTTP/1.1 Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX57sWJUiz1R99496GVUHQBu4n3hS3dRp00jZu_JQVhHMb0aSqz6CQzuF8emWoxRQcxfnL1V8lYCYnirU9Dp6eNMU8sRp7uPy9l6V0lU4ixBv4A-iXb1En7TFye_hSA_H_vkr2lnfzj312FmzKPZRe60lvUaDe75ITVIPBkQMF6Vg2g Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:16:59.833339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8daefbd914cc45a58999c6334c4e526f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8daefbd914cc45a58999c6334c4e526f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 8daefbd914cc45a58999c6334c4e526f Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-VolumesNegativeTest-464577022 Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 260fa9798af6456087bb20bff53b9192 Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-VolumesNegativeTest-464577022-project Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Volume e6a16b03-300f-4939-baf7-436f545ef5ee could not be found. Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'e6a16b03-300f-4939-baf7-436f545ef5ee'} Jun 21 08:16:59.834663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6a16b03-300f-4939-baf7-436f545ef5ee could not be found. (HTTP 404) (Request-ID: req-d1737fc3-fa9e-474b-ba27-b842e2a9bad8) Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.835437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 08:16:59.836456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6a16b03-300f-4939-baf7-436f545ef5ee could not be found. Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 08:16:59.837520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6a16b03-300f-4939-baf7-436f545ef5ee could not be found. Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6a16b03-300f-4939-baf7-436f545ef5ee could not be found. Jun 21 08:16:59.840193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:16:59.851079 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a45e9ece-d3a2-4f90-993d-c0185029e793 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] Returning 404 to user: Volume e6a16b03-300f-4939-baf7-436f545ef5ee could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:16:59.851079 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a45e9ece-d3a2-4f90-993d-c0185029e793 tempest-VolumesNegativeTest-464577022 tempest-VolumesNegativeTest-464577022-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e6a16b03-300f-4939-baf7-436f545ef5ee" status: 404 len: 109 microversion: 2.1 time: 0.061536 Jun 21 08:16:59.852003 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 139/266] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:16:59 2022] GET /compute/v2.1/os-volumes/e6a16b03-300f-4939-baf7-436f545ef5ee => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:17:00.065479 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1f982053-fae9-4199-a9de-5e3b716a8c5d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:00.076562 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1f982053-fae9-4199-a9de-5e3b716a8c5d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:00.086052 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1f982053-fae9-4199-a9de-5e3b716a8c5d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:00.087661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1f982053-fae9-4199-a9de-5e3b716a8c5d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:00.089844 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1f982053-fae9-4199-a9de-5e3b716a8c5d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:00.090658 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1f982053-fae9-4199-a9de-5e3b716a8c5d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:00.419083 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1f982053-fae9-4199-a9de-5e3b716a8c5d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:00.433428 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1f982053-fae9-4199-a9de-5e3b716a8c5d tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1314 microversion: 2.1 time: 0.378335 Jun 21 08:17:00.434448 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 128/267] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:00 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:00.450977 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9c23bd6f-c326-43b1-83cb-f1e9d55ef8c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:00.451635 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9c23bd6f-c326-43b1-83cb-f1e9d55ef8c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:00.460125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c23bd6f-c326-43b1-83cb-f1e9d55ef8c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:00.461025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c23bd6f-c326-43b1-83cb-f1e9d55ef8c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:00.461962 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c23bd6f-c326-43b1-83cb-f1e9d55ef8c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:00.462636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c23bd6f-c326-43b1-83cb-f1e9d55ef8c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:01.038871 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9c23bd6f-c326-43b1-83cb-f1e9d55ef8c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:01.052394 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9c23bd6f-c326-43b1-83cb-f1e9d55ef8c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.605322 Jun 21 08:17:01.061949 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 140/268] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:00 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:01.451211 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a3b1b457-05ec-46f0-a23b-4bbca9fefefc tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:01.452378 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a3b1b457-05ec-46f0-a23b-4bbca9fefefc tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:01.468889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a3b1b457-05ec-46f0-a23b-4bbca9fefefc tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:01.475462 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a3b1b457-05ec-46f0-a23b-4bbca9fefefc tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:01.476584 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a3b1b457-05ec-46f0-a23b-4bbca9fefefc tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:01.477893 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a3b1b457-05ec-46f0-a23b-4bbca9fefefc tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:01.766468 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a3b1b457-05ec-46f0-a23b-4bbca9fefefc tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:01.775818 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a3b1b457-05ec-46f0-a23b-4bbca9fefefc tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1314 microversion: 2.1 time: 0.328368 Jun 21 08:17:01.787017 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 129/269] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:01 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:02.069892 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0d8a5743-e901-41d3-9bcc-ac230340a5db tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:02.070609 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0d8a5743-e901-41d3-9bcc-ac230340a5db tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:02.080909 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0d8a5743-e901-41d3-9bcc-ac230340a5db tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:02.081976 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0d8a5743-e901-41d3-9bcc-ac230340a5db tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:02.086406 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0d8a5743-e901-41d3-9bcc-ac230340a5db tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:02.088737 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0d8a5743-e901-41d3-9bcc-ac230340a5db tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:02.306193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0d8a5743-e901-41d3-9bcc-ac230340a5db tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:02.316245 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0d8a5743-e901-41d3-9bcc-ac230340a5db tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.250922 Jun 21 08:17:02.317014 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 141/270] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:02 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:02.793286 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e3b4eab4-963c-4aaa-a5f7-abe51ee9c332 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:02.794612 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e3b4eab4-963c-4aaa-a5f7-abe51ee9c332 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:02.802241 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e3b4eab4-963c-4aaa-a5f7-abe51ee9c332 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:02.802937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e3b4eab4-963c-4aaa-a5f7-abe51ee9c332 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:02.804113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e3b4eab4-963c-4aaa-a5f7-abe51ee9c332 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:02.804548 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e3b4eab4-963c-4aaa-a5f7-abe51ee9c332 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:03.022227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e3b4eab4-963c-4aaa-a5f7-abe51ee9c332 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:03.031896 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e3b4eab4-963c-4aaa-a5f7-abe51ee9c332 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1498 microversion: 2.1 time: 0.241015 Jun 21 08:17:03.033633 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 130/271] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:02 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1498 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:03.336635 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-02f28023-2662-41ad-aad2-9866293319d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:03.338007 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-02f28023-2662-41ad-aad2-9866293319d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:03.350351 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-02f28023-2662-41ad-aad2-9866293319d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:03.351392 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-02f28023-2662-41ad-aad2-9866293319d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:03.354951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-02f28023-2662-41ad-aad2-9866293319d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:03.355612 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-02f28023-2662-41ad-aad2-9866293319d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:03.812055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-02f28023-2662-41ad-aad2-9866293319d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:03.830560 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-02f28023-2662-41ad-aad2-9866293319d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.499557 Jun 21 08:17:03.831678 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 142/272] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:03 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:03.985214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1afea49b-955a-4f08-ae09-457ccd9e24da tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:03.986732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1afea49b-955a-4f08-ae09-457ccd9e24da tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:03.993813 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1afea49b-955a-4f08-ae09-457ccd9e24da tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:03.994308 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1afea49b-955a-4f08-ae09-457ccd9e24da tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:04.004167 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1afea49b-955a-4f08-ae09-457ccd9e24da tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:04.005435 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1afea49b-955a-4f08-ae09-457ccd9e24da tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:04.052191 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1afea49b-955a-4f08-ae09-457ccd9e24da tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:17:04.195178 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1afea49b-955a-4f08-ae09-457ccd9e24da tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 204 len: 0 microversion: 2.1 time: 0.214586 Jun 21 08:17:04.196588 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 131/273] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:17:03 2022] DELETE /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:17:04.205385 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e279cf89-85b0-49b7-84c3-bcec7519f94c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:04.205851 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e279cf89-85b0-49b7-84c3-bcec7519f94c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:04.212042 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e279cf89-85b0-49b7-84c3-bcec7519f94c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:04.212532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e279cf89-85b0-49b7-84c3-bcec7519f94c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:04.213789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e279cf89-85b0-49b7-84c3-bcec7519f94c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:04.214239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e279cf89-85b0-49b7-84c3-bcec7519f94c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:04.455684 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e279cf89-85b0-49b7-84c3-bcec7519f94c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:04.464388 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e279cf89-85b0-49b7-84c3-bcec7519f94c tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1504 microversion: 2.1 time: 0.263686 Jun 21 08:17:04.465889 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 143/274] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:04 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:04.850437 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-42817f6f-4323-4e39-9b98-09a4d82fee7a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:04.851476 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-42817f6f-4323-4e39-9b98-09a4d82fee7a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:04.862191 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42817f6f-4323-4e39-9b98-09a4d82fee7a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:04.863263 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42817f6f-4323-4e39-9b98-09a4d82fee7a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:04.864082 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42817f6f-4323-4e39-9b98-09a4d82fee7a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:04.864522 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42817f6f-4323-4e39-9b98-09a4d82fee7a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:05.121502 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-42817f6f-4323-4e39-9b98-09a4d82fee7a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:05.131969 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-42817f6f-4323-4e39-9b98-09a4d82fee7a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.286426 Jun 21 08:17:05.132561 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 132/275] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:04 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:05.482139 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d83d92e5-5112-40cb-a147-5a79d2415c47 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:05.482786 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d83d92e5-5112-40cb-a147-5a79d2415c47 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:05.492816 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d83d92e5-5112-40cb-a147-5a79d2415c47 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:05.493278 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d83d92e5-5112-40cb-a147-5a79d2415c47 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:05.494059 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d83d92e5-5112-40cb-a147-5a79d2415c47 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:05.497751 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d83d92e5-5112-40cb-a147-5a79d2415c47 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:05.965491 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d83d92e5-5112-40cb-a147-5a79d2415c47 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:05.991327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d83d92e5-5112-40cb-a147-5a79d2415c47 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1504 microversion: 2.1 time: 0.510489 Jun 21 08:17:06.001447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 144/276] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:05 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:06.150932 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bece7e04-61e5-41a0-b8d9-00ae7dcf9cdb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:06.151567 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bece7e04-61e5-41a0-b8d9-00ae7dcf9cdb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:06.166521 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bece7e04-61e5-41a0-b8d9-00ae7dcf9cdb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:06.168406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bece7e04-61e5-41a0-b8d9-00ae7dcf9cdb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:06.170937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bece7e04-61e5-41a0-b8d9-00ae7dcf9cdb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:06.174498 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bece7e04-61e5-41a0-b8d9-00ae7dcf9cdb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:06.664534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-626b4dcb-2c06-4f02-9120-ba4da137ee47 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:06.665031 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-626b4dcb-2c06-4f02-9120-ba4da137ee47 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:06.680478 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-626b4dcb-2c06-4f02-9120-ba4da137ee47 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:06.681027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-626b4dcb-2c06-4f02-9120-ba4da137ee47 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:06.684991 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-626b4dcb-2c06-4f02-9120-ba4da137ee47 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:06.693184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-626b4dcb-2c06-4f02-9120-ba4da137ee47 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:06.761569 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-626b4dcb-2c06-4f02-9120-ba4da137ee47 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/ips" status: 200 len: 149 microversion: 2.1 time: 0.100893 Jun 21 08:17:06.771169 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 145/277] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 08:17:06 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/ips => generated 149 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:17:06.942086 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bece7e04-61e5-41a0-b8d9-00ae7dcf9cdb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:06.950839 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bece7e04-61e5-41a0-b8d9-00ae7dcf9cdb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.804943 Jun 21 08:17:06.955587 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 133/278] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:06 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:07.008972 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-55fd75e5-3bb3-4c61-a26d-87d77ee33f36 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:07.010142 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-55fd75e5-3bb3-4c61-a26d-87d77ee33f36 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:07.022089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-55fd75e5-3bb3-4c61-a26d-87d77ee33f36 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:07.022920 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-55fd75e5-3bb3-4c61-a26d-87d77ee33f36 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:07.023919 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-55fd75e5-3bb3-4c61-a26d-87d77ee33f36 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:07.028511 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-55fd75e5-3bb3-4c61-a26d-87d77ee33f36 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:07.518812 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-55fd75e5-3bb3-4c61-a26d-87d77ee33f36 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:07.528835 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-55fd75e5-3bb3-4c61-a26d-87d77ee33f36 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1504 microversion: 2.1 time: 0.521487 Jun 21 08:17:07.536982 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 146/279] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:07 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:07.972723 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-65d306df-fe63-49ac-9951-46d83e427ec6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:07.973338 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-65d306df-fe63-49ac-9951-46d83e427ec6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:07.993811 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-65d306df-fe63-49ac-9951-46d83e427ec6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:07.994270 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-65d306df-fe63-49ac-9951-46d83e427ec6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:07.995090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-65d306df-fe63-49ac-9951-46d83e427ec6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:07.995528 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-65d306df-fe63-49ac-9951-46d83e427ec6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:08.014083 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:08.244922 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-7487c1cd-f1a6-44ec-8cdb-9a021ae7c207 req-819b5a13-95c2-4232-b4d9-4e074e654d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1b7185-d26e-4a65-9b25-9a4cdf59b52a", "name": "network-vif-deleted", "tag": "4e320460-6ab7-482f-af30-5c7fb8b93b9f"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:08.261289 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-7487c1cd-f1a6-44ec-8cdb-9a021ae7c207 req-819b5a13-95c2-4232-b4d9-4e074e654d86 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:08.263645 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-7487c1cd-f1a6-44ec-8cdb-9a021ae7c207 req-819b5a13-95c2-4232-b4d9-4e074e654d86 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:08.296690 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-7487c1cd-f1a6-44ec-8cdb-9a021ae7c207 req-819b5a13-95c2-4232-b4d9-4e074e654d86 service nova] Creating event network-vif-deleted:4e320460-6ab7-482f-af30-5c7fb8b93b9f for instance eb1b7185-d26e-4a65-9b25-9a4cdf59b52a on hv-cinder-83697 Jun 21 08:17:08.310321 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-7487c1cd-f1a6-44ec-8cdb-9a021ae7c207 req-819b5a13-95c2-4232-b4d9-4e074e654d86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068868 Jun 21 08:17:08.311380 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 147/280] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:17:08.382514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-65d306df-fe63-49ac-9951-46d83e427ec6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:08.393054 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-65d306df-fe63-49ac-9951-46d83e427ec6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.425541 Jun 21 08:17:08.398393 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 134/281] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:07 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:08.549302 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-66b5af9a-e98c-4d7d-8edd-804b62c29ef2 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:08.550398 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-66b5af9a-e98c-4d7d-8edd-804b62c29ef2 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:08.568039 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-66b5af9a-e98c-4d7d-8edd-804b62c29ef2 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:08.569639 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-66b5af9a-e98c-4d7d-8edd-804b62c29ef2 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:08.570730 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-66b5af9a-e98c-4d7d-8edd-804b62c29ef2 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:08.577472 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-66b5af9a-e98c-4d7d-8edd-804b62c29ef2 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:08.688954 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-44d974d3-9bc4-47b0-8b15-76a6b20c5061 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "088f3edb-b15c-4b00-aa78-c16fd4f16dca"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:08.690128 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-44d974d3-9bc4-47b0-8b15-76a6b20c5061 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:08.714053 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-44d974d3-9bc4-47b0-8b15-76a6b20c5061 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:08.717221 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-44d974d3-9bc4-47b0-8b15-76a6b20c5061 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:08.718275 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-44d974d3-9bc4-47b0-8b15-76a6b20c5061 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:08.718979 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-44d974d3-9bc4-47b0-8b15-76a6b20c5061 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:09.187119 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-66b5af9a-e98c-4d7d-8edd-804b62c29ef2 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:09.196218 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-66b5af9a-e98c-4d7d-8edd-804b62c29ef2 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1462 microversion: 2.1 time: 0.656957 Jun 21 08:17:09.207615 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 148/282] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:08 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1462 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:09.416012 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-334a8f81-2533-4c25-87a7-f1da4696aaa7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:09.417751 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-334a8f81-2533-4c25-87a7-f1da4696aaa7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:09.428958 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-334a8f81-2533-4c25-87a7-f1da4696aaa7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:09.429788 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-334a8f81-2533-4c25-87a7-f1da4696aaa7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:09.431576 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-334a8f81-2533-4c25-87a7-f1da4696aaa7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:09.432222 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-334a8f81-2533-4c25-87a7-f1da4696aaa7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:09.448329 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:09.722125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-334a8f81-2533-4c25-87a7-f1da4696aaa7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:09.736332 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-334a8f81-2533-4c25-87a7-f1da4696aaa7 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1521 microversion: 2.1 time: 0.322268 Jun 21 08:17:09.737916 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 149/283] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:09 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:10.213944 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-382818ac-a9d9-4689-8106-a5474f1146ed tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:10.214566 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-382818ac-a9d9-4689-8106-a5474f1146ed tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:10.225837 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-382818ac-a9d9-4689-8106-a5474f1146ed tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:10.226859 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-382818ac-a9d9-4689-8106-a5474f1146ed tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:10.228935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-382818ac-a9d9-4689-8106-a5474f1146ed tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:10.229596 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-382818ac-a9d9-4689-8106-a5474f1146ed tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:10.345385 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-382818ac-a9d9-4689-8106-a5474f1146ed tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:10.356381 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-382818ac-a9d9-4689-8106-a5474f1146ed tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1462 microversion: 2.1 time: 0.146638 Jun 21 08:17:10.357463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 150/284] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:10 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1462 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:10.960618 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b2fe4b76-5c3c-4c0c-82f0-b89d0521aeb6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Action: 'create', calling method: .version_select at 0x7fded8059280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1346110402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+Ueg3bFvelp1rdkQjc+UrLtPBaJvi2E+P5Dv1JX3zXr8gnbHLrwm5dkX0zjIqJ9bsuimqDKur7nRZcHLKfAXvYlXY+81xamBKndPBear2g3oN8CRpCJEVvkonXMEqcsA=="}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:10.983491 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-b2fe4b76-5c3c-4c0c-82f0-b89d0521aeb6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Getting quotas for project cad2999c58284b92b7166848a3e1f261. Resources: {'key_pairs'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:17:10.993935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-b2fe4b76-5c3c-4c0c-82f0-b89d0521aeb6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Getting quotas for user 8b54a55cff584d948b96c1c439e57eda and project cad2999c58284b92b7166848a3e1f261. Resources: {'key_pairs'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:17:11.042596 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b2fe4b76-5c3c-4c0c-82f0-b89d0521aeb6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.389921 Jun 21 08:17:11.043356 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 151/285] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 08:17:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:17:11.063392 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c7e28c70-47f5-4487-87c8-351605688f2c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:11.065150 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c7e28c70-47f5-4487-87c8-351605688f2c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:11.086135 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c7e28c70-47f5-4487-87c8-351605688f2c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:11.086689 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c7e28c70-47f5-4487-87c8-351605688f2c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:11.089449 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c7e28c70-47f5-4487-87c8-351605688f2c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:11.089914 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c7e28c70-47f5-4487-87c8-351605688f2c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:11.127962 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-44d974d3-9bc4-47b0-8b15-76a6b20c5061 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.454358 Jun 21 08:17:11.138832 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 135/286] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:17:08 2022] POST /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-volume_attachments => generated 194 bytes in 2468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:17:11.379546 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:11.380598 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:11.396464 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c7e28c70-47f5-4487-87c8-351605688f2c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:11.421204 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c7e28c70-47f5-4487-87c8-351605688f2c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1501 microversion: 2.1 time: 0.376362 Jun 21 08:17:11.422448 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 152/287] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:11 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1501 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:11.442013 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:11.442488 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:11.444395 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-82af3da2-becd-40ae-9b5f-1c413b4d5c1c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:11.445219 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-82af3da2-becd-40ae-9b5f-1c413b4d5c1c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:11.446372 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:11.450137 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:11.461882 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82af3da2-becd-40ae-9b5f-1c413b4d5c1c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:11.462436 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82af3da2-becd-40ae-9b5f-1c413b4d5c1c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:11.463442 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82af3da2-becd-40ae-9b5f-1c413b4d5c1c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:11.463977 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82af3da2-becd-40ae-9b5f-1c413b4d5c1c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:11.618750 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:11.622671 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:11.625025 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lazy-loading 'fault' on Instance uuid eb1b7185-d26e-4a65-9b25-9a4cdf59b52a {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:17:11.763879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e816a85da046fbb8a02f9a84ecd6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ebfe281cb442e18830e44768082fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:11.772892 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-41d765c8-061d-4c76-9192-cf2da9993001 tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 200 len: 1304 microversion: 2.1 time: 0.401560 Jun 21 08:17:11.787762 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 136/288] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:11 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 1304 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:11.854351 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-82af3da2-becd-40ae-9b5f-1c413b4d5c1c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:11.870420 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-82af3da2-becd-40ae-9b5f-1c413b4d5c1c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1515 microversion: 2.1 time: 0.432420 Jun 21 08:17:11.872497 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 153/289] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:11 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1515 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:12.798522 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-04be19b2-1f9d-4e2e-85ad-9b462c24f1ff tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:12.799919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-04be19b2-1f9d-4e2e-85ad-9b462c24f1ff tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] [instance: eb1b7185-d26e-4a65-9b25-9a4cdf59b52a] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:12.806879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04be19b2-1f9d-4e2e-85ad-9b462c24f1ff tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:12.807388 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04be19b2-1f9d-4e2e-85ad-9b462c24f1ff tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:12.808162 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04be19b2-1f9d-4e2e-85ad-9b462c24f1ff tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:12.808740 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04be19b2-1f9d-4e2e-85ad-9b462c24f1ff tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:12.850142 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-04be19b2-1f9d-4e2e-85ad-9b462c24f1ff tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] HTTP exception thrown: Instance eb1b7185-d26e-4a65-9b25-9a4cdf59b52a could not be found. Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-04be19b2-1f9d-4e2e-85ad-9b462c24f1ff tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Request method failure captured: Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a HTTP/1.1 Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX5WX8iXcsnG-BPv7o5ZgEhAoSm_e4oKP-cp5fhhhloMRLQ77-sgagIooTn_rT5TYEkxURvdckAh8sSpJGxMZCGCsc79mJ4NEno7BB6QBCiFKWAEN2ciUBDULY5Eln7Ywymr_RxvwsXnFSjYbh5z8U6QE3sN1NnjeFBkuwFb5CpDHgc Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d0ebfe281cb442e18830e44768082fdd Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-VolumesActionsTest-20242860 Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:17:12.852412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d0ebfe281cb442e18830e44768082fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d0ebfe281cb442e18830e44768082fdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d0ebfe281cb442e18830e44768082fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d0ebfe281cb442e18830e44768082fdd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-VolumesActionsTest-20242860 Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d0ebfe281cb442e18830e44768082fdd Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-VolumesActionsTest-20242860 Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-VolumesActionsTest-20242860-project Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 48e816a85da046fbb8a02f9a84ecd6fb Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-VolumesActionsTest-20242860-project Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance eb1b7185-d26e-4a65-9b25-9a4cdf59b52a could not be found. Jun 21 08:17:12.853902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'eb1b7185-d26e-4a65-9b25-9a4cdf59b52a'} Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb1b7185-d26e-4a65-9b25-9a4cdf59b52a could not be found. Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:17:12.854734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb1b7185-d26e-4a65-9b25-9a4cdf59b52a could not be found. Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb1b7185-d26e-4a65-9b25-9a4cdf59b52a could not be found. Jun 21 08:17:12.856107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:17:12.860890 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-04be19b2-1f9d-4e2e-85ad-9b462c24f1ff tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] Returning 404 to user: Instance eb1b7185-d26e-4a65-9b25-9a4cdf59b52a could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:17:12.863454 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-04be19b2-1f9d-4e2e-85ad-9b462c24f1ff tempest-VolumesActionsTest-20242860 tempest-VolumesActionsTest-20242860-project] 10.222.0.36 "GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a" status: 404 len: 111 microversion: 2.1 time: 0.073645 Jun 21 08:17:12.866775 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 137/290] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:12 2022] GET /compute/v2.1/servers/eb1b7185-d26e-4a65-9b25-9a4cdf59b52a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:17:13.681728 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a5db62d1-ce71-42b6-b8fb-aa2098864145 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:13.682914 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a5db62d1-ce71-42b6-b8fb-aa2098864145 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:13.696839 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a5db62d1-ce71-42b6-b8fb-aa2098864145 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:13.697528 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a5db62d1-ce71-42b6-b8fb-aa2098864145 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:13.699084 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a5db62d1-ce71-42b6-b8fb-aa2098864145 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:13.700045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a5db62d1-ce71-42b6-b8fb-aa2098864145 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:13.783694 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-a5db62d1-ce71-42b6-b8fb-aa2098864145 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lazy-loading 'flavor' on Instance uuid ebe8e00a-97d1-4e7c-8a02-db6a981670fc {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:17:14.062208 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a5db62d1-ce71-42b6-b8fb-aa2098864145 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc/action" status: 200 len: 32 microversion: 2.1 time: 0.397268 Jun 21 08:17:14.064976 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 154/291] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:17:13 2022] POST /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc/action => generated 32 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:17:14.074812 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f1c6b31e-82f2-48d8-a15c-1cc74893ba00 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:14.075539 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f1c6b31e-82f2-48d8-a15c-1cc74893ba00 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:14.099393 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f1c6b31e-82f2-48d8-a15c-1cc74893ba00 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:14.100121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f1c6b31e-82f2-48d8-a15c-1cc74893ba00 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:14.101701 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f1c6b31e-82f2-48d8-a15c-1cc74893ba00 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:14.102342 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f1c6b31e-82f2-48d8-a15c-1cc74893ba00 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:14.598459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f1c6b31e-82f2-48d8-a15c-1cc74893ba00 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:14.617381 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f1c6b31e-82f2-48d8-a15c-1cc74893ba00 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.545558 Jun 21 08:17:14.626838 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 138/292] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:14 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:15.637940 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3713fef7-c91b-4405-a629-36fdfb69459f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:15.639417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3713fef7-c91b-4405-a629-36fdfb69459f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:15.650323 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3713fef7-c91b-4405-a629-36fdfb69459f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:15.651104 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3713fef7-c91b-4405-a629-36fdfb69459f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:15.652160 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3713fef7-c91b-4405-a629-36fdfb69459f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:15.652805 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3713fef7-c91b-4405-a629-36fdfb69459f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:15.964125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-3713fef7-c91b-4405-a629-36fdfb69459f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:15.973430 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3713fef7-c91b-4405-a629-36fdfb69459f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.341910 Jun 21 08:17:15.974130 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 155/293] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:15 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:16.992364 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1e033c28-feac-4c7d-be7e-ed6dec8804dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:16.993910 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1e033c28-feac-4c7d-be7e-ed6dec8804dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:17.001379 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1e033c28-feac-4c7d-be7e-ed6dec8804dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:17.003235 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1e033c28-feac-4c7d-be7e-ed6dec8804dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:17.004349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1e033c28-feac-4c7d-be7e-ed6dec8804dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:17.006638 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1e033c28-feac-4c7d-be7e-ed6dec8804dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:17.305675 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1e033c28-feac-4c7d-be7e-ed6dec8804dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:17.323073 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1e033c28-feac-4c7d-be7e-ed6dec8804dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.333697 Jun 21 08:17:17.338805 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 139/294] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:16 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:18.348816 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9f700f45-b976-4f31-8284-efd1513c9d38 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:18.350501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9f700f45-b976-4f31-8284-efd1513c9d38 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:18.358378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:18.365646 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9f700f45-b976-4f31-8284-efd1513c9d38 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:18.366264 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9f700f45-b976-4f31-8284-efd1513c9d38 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:18.367726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9f700f45-b976-4f31-8284-efd1513c9d38 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:18.370708 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9f700f45-b976-4f31-8284-efd1513c9d38 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:19.195427 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9f700f45-b976-4f31-8284-efd1513c9d38 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:19.214651 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9f700f45-b976-4f31-8284-efd1513c9d38 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.872412 Jun 21 08:17:19.216425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 156/295] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:18 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:19.337846 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9ac4911d-6ee7-49f5-9ccf-f82e5b591e75 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: .version_select at 0x7fded812e160>, body: {"keypair": {"name": "tempest-keypair-259946910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvERwLEyeq4jCe54SMhpxytqrcVIODj79K0aXM53xJ9ScXihwhwtcg2hyEHoeDRBkUVU24/l/UjhW3hnXBusEhTxqdiO7NYaQXLFAI0w9sG65uuDei0bkPyfWSBx4HX0A=="}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:19.398908 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-9ac4911d-6ee7-49f5-9ccf-f82e5b591e75 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:17:19.425976 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-9ac4911d-6ee7-49f5-9ccf-f82e5b591e75 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for user de0dccd8f960443894a99baa79198005 and project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:17:19.483833 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9ac4911d-6ee7-49f5-9ccf-f82e5b591e75 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149179 Jun 21 08:17:19.491428 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 140/296] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 08:17:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:17:20.256989 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1631b040-159a-4eec-87a6-742bea34e833 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:20.258338 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1631b040-159a-4eec-87a6-742bea34e833 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:20.285999 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1631b040-159a-4eec-87a6-742bea34e833 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:20.286455 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1631b040-159a-4eec-87a6-742bea34e833 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:20.287263 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1631b040-159a-4eec-87a6-742bea34e833 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:20.294558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1631b040-159a-4eec-87a6-742bea34e833 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:20.909690 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1631b040-159a-4eec-87a6-742bea34e833 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:20.925939 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1631b040-159a-4eec-87a6-742bea34e833 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.678174 Jun 21 08:17:20.933785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 157/297] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:20 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:21.950526 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-60945135-1516-48e1-884f-16fa63407983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:21.952295 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-60945135-1516-48e1-884f-16fa63407983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:21.973043 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60945135-1516-48e1-884f-16fa63407983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:21.975703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60945135-1516-48e1-884f-16fa63407983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:21.983258 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60945135-1516-48e1-884f-16fa63407983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:21.983706 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60945135-1516-48e1-884f-16fa63407983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:22.726584 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-60945135-1516-48e1-884f-16fa63407983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:22.741124 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-60945135-1516-48e1-884f-16fa63407983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.795447 Jun 21 08:17:22.743237 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 141/298] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:21 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:23.719010 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1831946541", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbf78e3a-7b50-434f-bb05-1e295b095c9f"}], "security_groups": [{"name": "tempest-securitygroup--1506059771"}], "key_name": "tempest-keypair-259946910", "user_data": "}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:23.767878 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8b8a2209-da8f-4a48-902f-2d1bda0c993c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:23.769042 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8b8a2209-da8f-4a48-902f-2d1bda0c993c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:23.781360 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:23.782808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=4 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:23.798234 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8b8a2209-da8f-4a48-902f-2d1bda0c993c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:23.802983 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8b8a2209-da8f-4a48-902f-2d1bda0c993c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:23.804162 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8b8a2209-da8f-4a48-902f-2d1bda0c993c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:23.838720 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8b8a2209-da8f-4a48-902f-2d1bda0c993c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:24.257337 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8b8a2209-da8f-4a48-902f-2d1bda0c993c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:24.274312 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8b8a2209-da8f-4a48-902f-2d1bda0c993c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.513250 Jun 21 08:17:24.274312 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 142/299] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:23 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:25.290094 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ec458a96-41dd-4323-8842-066d76e62919 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:25.291013 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-ec458a96-41dd-4323-8842-066d76e62919 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:25.318254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ec458a96-41dd-4323-8842-066d76e62919 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:25.318807 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ec458a96-41dd-4323-8842-066d76e62919 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:25.324741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ec458a96-41dd-4323-8842-066d76e62919 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:25.325183 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ec458a96-41dd-4323-8842-066d76e62919 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:25.664503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-ec458a96-41dd-4323-8842-066d76e62919 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:25.678128 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ec458a96-41dd-4323-8842-066d76e62919 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.392364 Jun 21 08:17:25.684955 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 143/300] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:25 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:26.719216 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b6b66e54-973e-4a8a-a132-833cb1bf0a77 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:26.719961 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b6b66e54-973e-4a8a-a132-833cb1bf0a77 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:26.734050 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b6b66e54-973e-4a8a-a132-833cb1bf0a77 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:26.734499 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b6b66e54-973e-4a8a-a132-833cb1bf0a77 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:26.735313 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b6b66e54-973e-4a8a-a132-833cb1bf0a77 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:26.735880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b6b66e54-973e-4a8a-a132-833cb1bf0a77 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:26.946939 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b6b66e54-973e-4a8a-a132-833cb1bf0a77 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:26.965365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b6b66e54-973e-4a8a-a132-833cb1bf0a77 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.264407 Jun 21 08:17:26.966250 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 144/301] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:26 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:27.991365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e03a54ff-e815-4913-b024-962853756fff tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:27.992049 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e03a54ff-e815-4913-b024-962853756fff tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:28.002849 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e03a54ff-e815-4913-b024-962853756fff tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:28.003326 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e03a54ff-e815-4913-b024-962853756fff tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:28.004431 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e03a54ff-e815-4913-b024-962853756fff tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:28.005079 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e03a54ff-e815-4913-b024-962853756fff tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:28.226077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e03a54ff-e815-4913-b024-962853756fff tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:28.240195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e03a54ff-e815-4913-b024-962853756fff tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.258440 Jun 21 08:17:28.257275 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 145/302] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:27 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:28.261236 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-11dfc9bd-fdd3-4b4a-93b9-092d26b6c47a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:28.262175 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-11dfc9bd-fdd3-4b4a-93b9-092d26b6c47a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:28.268702 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-11dfc9bd-fdd3-4b4a-93b9-092d26b6c47a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:28.269307 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-11dfc9bd-fdd3-4b4a-93b9-092d26b6c47a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:28.270161 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-11dfc9bd-fdd3-4b4a-93b9-092d26b6c47a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:28.270976 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-11dfc9bd-fdd3-4b4a-93b9-092d26b6c47a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:28.295482 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-11dfc9bd-fdd3-4b4a-93b9-092d26b6c47a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/ips" status: 200 len: 146 microversion: 2.1 time: 0.041779 Jun 21 08:17:28.296387 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 146/303] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 08:17:28 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:17:29.267787 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0973d6a9-1e66-41bc-9b74-2f3858481f0e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:29.269115 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0973d6a9-1e66-41bc-9b74-2f3858481f0e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:29.290692 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0973d6a9-1e66-41bc-9b74-2f3858481f0e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:29.291425 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0973d6a9-1e66-41bc-9b74-2f3858481f0e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:29.292865 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0973d6a9-1e66-41bc-9b74-2f3858481f0e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:29.299459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0973d6a9-1e66-41bc-9b74-2f3858481f0e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:29.437942 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=4 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:29.541479 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0973d6a9-1e66-41bc-9b74-2f3858481f0e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:29.554411 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0973d6a9-1e66-41bc-9b74-2f3858481f0e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.291327 Jun 21 08:17:29.582206 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 147/304] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:29 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:30.586668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1ca7f7e1-7b9c-42b8-9fba-483442216fe8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:30.592457 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1ca7f7e1-7b9c-42b8-9fba-483442216fe8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:30.601317 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ca7f7e1-7b9c-42b8-9fba-483442216fe8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:30.602192 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ca7f7e1-7b9c-42b8-9fba-483442216fe8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:30.603383 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ca7f7e1-7b9c-42b8-9fba-483442216fe8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:30.604047 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ca7f7e1-7b9c-42b8-9fba-483442216fe8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:30.914364 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:30.915598 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1ca7f7e1-7b9c-42b8-9fba-483442216fe8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:30.931907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1ca7f7e1-7b9c-42b8-9fba-483442216fe8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.355191 Jun 21 08:17:30.933267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 148/305] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:30 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:30.948114 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8af1ad44-6b27-4826-badb-43b5b0a7a0e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "419e97b8-a520-4e3f-94b8-df3ea83e2596"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:30.949590 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8af1ad44-6b27-4826-badb-43b5b0a7a0e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:30.974818 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8af1ad44-6b27-4826-badb-43b5b0a7a0e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:30.976905 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8af1ad44-6b27-4826-badb-43b5b0a7a0e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:30.977907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8af1ad44-6b27-4826-badb-43b5b0a7a0e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:30.978548 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8af1ad44-6b27-4826-badb-43b5b0a7a0e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:31.431437 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:31.441169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8af1ad44-6b27-4826-badb-43b5b0a7a0e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506421 Jun 21 08:17:31.441965 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 149/306] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:17:30 2022] POST /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:17:31.954881 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b0705e11-69c2-453a-8028-4815977e1bcb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:31.956434 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b0705e11-69c2-453a-8028-4815977e1bcb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:31.966405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b0705e11-69c2-453a-8028-4815977e1bcb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:31.967235 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b0705e11-69c2-453a-8028-4815977e1bcb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:31.968891 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b0705e11-69c2-453a-8028-4815977e1bcb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:31.969689 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b0705e11-69c2-453a-8028-4815977e1bcb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:32.107659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] validate_networks() for [('bbf78e3a-7b50-434f-bb05-1e295b095c9f', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:17:32.191161 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b0705e11-69c2-453a-8028-4815977e1bcb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:32.204369 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b0705e11-69c2-453a-8028-4815977e1bcb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.254791 Jun 21 08:17:32.204669 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 150/307] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:31 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:32.579575 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:17:32.580358 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:17:32.581089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:17:32.581705 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:17:32.582323 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:17:32.601902 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:32.604727 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:32.605880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:32.606712 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:32.638992 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:17:32.646601 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for user de0dccd8f960443894a99baa79198005 and project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:17:32.663085 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:17:32.665674 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:17:32.726520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fed3b6aa-b0cf-4a8e-8aac-8c570880ca99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 9.013869 Jun 21 08:17:32.727350 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 158/308] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:17:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 9016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:17:32.737960 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e5b0403f-a979-4f1f-9f0a-e49016eae3a9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:32.738877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e5b0403f-a979-4f1f-9f0a-e49016eae3a9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:32.813877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e5b0403f-a979-4f1f-9f0a-e49016eae3a9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:32.821443 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e5b0403f-a979-4f1f-9f0a-e49016eae3a9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1241 microversion: 2.1 time: 0.087767 Jun 21 08:17:32.835764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 151/309] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:32 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:33.221674 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5087ddfa-272d-4075-bc8c-d54a38927975 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:33.222365 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5087ddfa-272d-4075-bc8c-d54a38927975 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:33.231230 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5087ddfa-272d-4075-bc8c-d54a38927975 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:33.231996 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5087ddfa-272d-4075-bc8c-d54a38927975 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:33.232780 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5087ddfa-272d-4075-bc8c-d54a38927975 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:33.233211 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5087ddfa-272d-4075-bc8c-d54a38927975 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:33.541489 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5087ddfa-272d-4075-bc8c-d54a38927975 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:33.550048 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5087ddfa-272d-4075-bc8c-d54a38927975 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.333105 Jun 21 08:17:33.551199 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 159/310] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:33 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:33.844872 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-dc52c7b3-854e-494a-874c-5f2b75ad9914 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:33.846161 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-dc52c7b3-854e-494a-874c-5f2b75ad9914 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:33.855711 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc52c7b3-854e-494a-874c-5f2b75ad9914 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:33.856448 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc52c7b3-854e-494a-874c-5f2b75ad9914 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:33.857226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc52c7b3-854e-494a-874c-5f2b75ad9914 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:33.857654 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc52c7b3-854e-494a-874c-5f2b75ad9914 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:33.920979 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-dc52c7b3-854e-494a-874c-5f2b75ad9914 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:33.929977 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-dc52c7b3-854e-494a-874c-5f2b75ad9914 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1245 microversion: 2.1 time: 0.093211 Jun 21 08:17:33.930587 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 152/311] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:33 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:34.614934 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-047b34af-4a1b-4734-a510-fd1934650b31 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:34.616489 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-047b34af-4a1b-4734-a510-fd1934650b31 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:34.640585 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-047b34af-4a1b-4734-a510-fd1934650b31 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:34.643881 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-047b34af-4a1b-4734-a510-fd1934650b31 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:34.645041 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-047b34af-4a1b-4734-a510-fd1934650b31 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:34.645663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-047b34af-4a1b-4734-a510-fd1934650b31 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:34.950354 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4e857ab3-f0bf-4050-bd8e-5924149e40ad tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:34.951449 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4e857ab3-f0bf-4050-bd8e-5924149e40ad tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:34.961184 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e857ab3-f0bf-4050-bd8e-5924149e40ad tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:34.961633 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e857ab3-f0bf-4050-bd8e-5924149e40ad tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:34.962399 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e857ab3-f0bf-4050-bd8e-5924149e40ad tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:34.969874 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e857ab3-f0bf-4050-bd8e-5924149e40ad tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:35.054692 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-047b34af-4a1b-4734-a510-fd1934650b31 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:35.071803 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-047b34af-4a1b-4734-a510-fd1934650b31 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.504278 Jun 21 08:17:35.075876 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 160/312] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:34 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:35.126408 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4e857ab3-f0bf-4050-bd8e-5924149e40ad tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:35.138798 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4e857ab3-f0bf-4050-bd8e-5924149e40ad tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1237 microversion: 2.1 time: 0.192907 Jun 21 08:17:35.140937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 153/313] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:34 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1237 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:36.099863 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a65f54ce-abf7-400f-9e71-50afbab4b52d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:36.101056 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a65f54ce-abf7-400f-9e71-50afbab4b52d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:36.113283 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a65f54ce-abf7-400f-9e71-50afbab4b52d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:36.113742 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a65f54ce-abf7-400f-9e71-50afbab4b52d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:36.114528 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a65f54ce-abf7-400f-9e71-50afbab4b52d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:36.115004 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a65f54ce-abf7-400f-9e71-50afbab4b52d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:36.159077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8313a5e9-e8ce-481d-a64c-8ed920f69561 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:36.160337 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8313a5e9-e8ce-481d-a64c-8ed920f69561 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:36.183657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8313a5e9-e8ce-481d-a64c-8ed920f69561 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:36.188466 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8313a5e9-e8ce-481d-a64c-8ed920f69561 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:36.190153 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8313a5e9-e8ce-481d-a64c-8ed920f69561 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:36.192749 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8313a5e9-e8ce-481d-a64c-8ed920f69561 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:36.332703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8313a5e9-e8ce-481d-a64c-8ed920f69561 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:36.343422 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8313a5e9-e8ce-481d-a64c-8ed920f69561 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1293 microversion: 2.1 time: 0.190183 Jun 21 08:17:36.365389 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 154/314] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:36 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1293 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:36.440288 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a65f54ce-abf7-400f-9e71-50afbab4b52d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:36.449119 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a65f54ce-abf7-400f-9e71-50afbab4b52d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.359443 Jun 21 08:17:36.450521 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 161/315] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:36 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:37.365006 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1861db71-b41f-42f9-b704-563a698fe1e5 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:37.366379 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1861db71-b41f-42f9-b704-563a698fe1e5 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:37.373250 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1861db71-b41f-42f9-b704-563a698fe1e5 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:37.373988 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1861db71-b41f-42f9-b704-563a698fe1e5 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:37.375731 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1861db71-b41f-42f9-b704-563a698fe1e5 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:37.376378 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1861db71-b41f-42f9-b704-563a698fe1e5 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:37.469576 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-53c6130b-cd68-4b7f-9276-a2c90188b796 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:37.470314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-53c6130b-cd68-4b7f-9276-a2c90188b796 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:37.481554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-53c6130b-cd68-4b7f-9276-a2c90188b796 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:37.482092 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-53c6130b-cd68-4b7f-9276-a2c90188b796 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:37.483007 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-53c6130b-cd68-4b7f-9276-a2c90188b796 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:37.488929 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-53c6130b-cd68-4b7f-9276-a2c90188b796 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:37.511481 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1861db71-b41f-42f9-b704-563a698fe1e5 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:37.521099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1861db71-b41f-42f9-b704-563a698fe1e5 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1293 microversion: 2.1 time: 0.159732 Jun 21 08:17:37.530664 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 155/316] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:37 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:37.713910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-53c6130b-cd68-4b7f-9276-a2c90188b796 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:37.723785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-53c6130b-cd68-4b7f-9276-a2c90188b796 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.258365 Jun 21 08:17:37.725115 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 162/317] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:37 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:38.559289 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d2d7e264-89df-4b57-8e58-37e035ea069b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:38.560250 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d2d7e264-89df-4b57-8e58-37e035ea069b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:38.569031 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2d7e264-89df-4b57-8e58-37e035ea069b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:38.570317 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2d7e264-89df-4b57-8e58-37e035ea069b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:38.576802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2d7e264-89df-4b57-8e58-37e035ea069b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:38.577701 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2d7e264-89df-4b57-8e58-37e035ea069b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:38.744669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-723ac18d-f0ce-4d10-88b0-2fee562fb624 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:38.748773 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-723ac18d-f0ce-4d10-88b0-2fee562fb624 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:38.769054 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-723ac18d-f0ce-4d10-88b0-2fee562fb624 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:38.769816 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-723ac18d-f0ce-4d10-88b0-2fee562fb624 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:38.772647 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-723ac18d-f0ce-4d10-88b0-2fee562fb624 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:38.773266 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-723ac18d-f0ce-4d10-88b0-2fee562fb624 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:38.801826 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d2d7e264-89df-4b57-8e58-37e035ea069b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:38.824619 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d2d7e264-89df-4b57-8e58-37e035ea069b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1299 microversion: 2.1 time: 0.290734 Jun 21 08:17:38.842282 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 156/318] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:38 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1299 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:39.116758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-723ac18d-f0ce-4d10-88b0-2fee562fb624 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:39.129404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-723ac18d-f0ce-4d10-88b0-2fee562fb624 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.389704 Jun 21 08:17:39.130896 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 163/319] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:38 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:39.844870 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7acd08b4-08fe-4c62-abbd-3bff7912c58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:39.844870 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-7acd08b4-08fe-4c62-abbd-3bff7912c58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:39.870758 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7acd08b4-08fe-4c62-abbd-3bff7912c58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:39.875823 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7acd08b4-08fe-4c62-abbd-3bff7912c58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:39.879625 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7acd08b4-08fe-4c62-abbd-3bff7912c58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:39.882235 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7acd08b4-08fe-4c62-abbd-3bff7912c58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:40.149227 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d6e1da64-fa3b-44a0-8d47-b794b77e1242 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:40.150460 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d6e1da64-fa3b-44a0-8d47-b794b77e1242 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:40.165163 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d6e1da64-fa3b-44a0-8d47-b794b77e1242 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:40.165871 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d6e1da64-fa3b-44a0-8d47-b794b77e1242 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:40.167033 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d6e1da64-fa3b-44a0-8d47-b794b77e1242 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:40.167638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d6e1da64-fa3b-44a0-8d47-b794b77e1242 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:40.236939 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-7acd08b4-08fe-4c62-abbd-3bff7912c58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:40.248768 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7acd08b4-08fe-4c62-abbd-3bff7912c58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.409696 Jun 21 08:17:40.263502 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 157/320] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:39 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:40.533509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d6e1da64-fa3b-44a0-8d47-b794b77e1242 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:40.555948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d6e1da64-fa3b-44a0-8d47-b794b77e1242 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.410704 Jun 21 08:17:40.557698 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 164/321] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:40 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:40.929970 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-1c727c73-9067-43c6-a863-e97a8887428b req-66819096-e714-455e-aa28-4c4ae86742ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6909a083-0588-4b06-916a-e9b153960ffa", "tag": "b38df0c4-4ff4-4131-becf-c141ab0b4a03"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:40.947259 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-1c727c73-9067-43c6-a863-e97a8887428b req-66819096-e714-455e-aa28-4c4ae86742ec service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:40.948090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-1c727c73-9067-43c6-a863-e97a8887428b req-66819096-e714-455e-aa28-4c4ae86742ec service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:40.990966 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-1c727c73-9067-43c6-a863-e97a8887428b req-66819096-e714-455e-aa28-4c4ae86742ec service nova] Creating event network-changed:b38df0c4-4ff4-4131-becf-c141ab0b4a03 for instance 6909a083-0588-4b06-916a-e9b153960ffa on hv-cinder-83697 Jun 21 08:17:41.005077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-1c727c73-9067-43c6-a863-e97a8887428b req-66819096-e714-455e-aa28-4c4ae86742ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087060 Jun 21 08:17:41.018041 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 158/322] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:17:41.273892 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-32544230-bc3d-4ade-821f-d070d260789c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:41.274568 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-32544230-bc3d-4ade-821f-d070d260789c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:41.284763 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-32544230-bc3d-4ade-821f-d070d260789c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:41.285228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-32544230-bc3d-4ade-821f-d070d260789c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:41.286023 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-32544230-bc3d-4ade-821f-d070d260789c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:41.286465 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-32544230-bc3d-4ade-821f-d070d260789c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:41.575987 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f973ba5d-bff2-4ff3-87dd-9bda326ffa3e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:41.576960 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f973ba5d-bff2-4ff3-87dd-9bda326ffa3e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:41.599989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f973ba5d-bff2-4ff3-87dd-9bda326ffa3e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:41.603390 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f973ba5d-bff2-4ff3-87dd-9bda326ffa3e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:41.604459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f973ba5d-bff2-4ff3-87dd-9bda326ffa3e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:41.611401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-32544230-bc3d-4ade-821f-d070d260789c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:41.616686 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f973ba5d-bff2-4ff3-87dd-9bda326ffa3e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:41.623832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-32544230-bc3d-4ade-821f-d070d260789c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.355430 Jun 21 08:17:41.642873 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 165/323] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:41 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:42.387218 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f973ba5d-bff2-4ff3-87dd-9bda326ffa3e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:42.406273 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f973ba5d-bff2-4ff3-87dd-9bda326ffa3e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.835925 Jun 21 08:17:42.419438 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 159/324] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:41 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:42.648229 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5c439e39-4dd2-4d39-ba2b-e410aae747c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:42.648890 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5c439e39-4dd2-4d39-ba2b-e410aae747c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:42.662100 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:42.663606 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=6 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:42.669499 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c439e39-4dd2-4d39-ba2b-e410aae747c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:42.670032 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c439e39-4dd2-4d39-ba2b-e410aae747c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:42.673122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c439e39-4dd2-4d39-ba2b-e410aae747c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:42.673775 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c439e39-4dd2-4d39-ba2b-e410aae747c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:42.996943 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5c439e39-4dd2-4d39-ba2b-e410aae747c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:43.017542 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5c439e39-4dd2-4d39-ba2b-e410aae747c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.375264 Jun 21 08:17:43.021816 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 166/325] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:42 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:43.435331 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b107f37c-2697-4ebd-963b-6dd045917b06 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:43.443484 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b107f37c-2697-4ebd-963b-6dd045917b06 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:43.495437 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:43.542138 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b107f37c-2697-4ebd-963b-6dd045917b06 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:43.548495 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b107f37c-2697-4ebd-963b-6dd045917b06 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:43.549687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b107f37c-2697-4ebd-963b-6dd045917b06 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:43.550321 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b107f37c-2697-4ebd-963b-6dd045917b06 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:43.849718 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b107f37c-2697-4ebd-963b-6dd045917b06 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:43.869574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b107f37c-2697-4ebd-963b-6dd045917b06 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.442650 Jun 21 08:17:43.870379 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 160/326] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:43 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:44.036114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-267a358a-03b5-4676-a318-0ef6b3d19036 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:44.036724 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-267a358a-03b5-4676-a318-0ef6b3d19036 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:44.045383 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-267a358a-03b5-4676-a318-0ef6b3d19036 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:44.045834 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-267a358a-03b5-4676-a318-0ef6b3d19036 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:44.055195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-267a358a-03b5-4676-a318-0ef6b3d19036 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:44.055897 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-267a358a-03b5-4676-a318-0ef6b3d19036 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:44.324353 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-267a358a-03b5-4676-a318-0ef6b3d19036 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:44.343529 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-267a358a-03b5-4676-a318-0ef6b3d19036 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.310176 Jun 21 08:17:44.344865 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 167/327] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:44 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:44.533106 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b7c3e4e6-5798-4c2d-9d5b-311ca3787f32 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Action: 'create', calling method: .version_select at 0x7fded836c310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-815556871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8mLheHz3ABTcWrzZ+gLkK3fpXvfZ+fyD/DZ+SSQEtM5G870yiQVy04Ak8BEZYEru3RmiZuDxeYAxtI9dOkO+66WfdHnx4aEt1vWr3yWt+HYi3NAqEelcIxUi7UEWl3mw=="}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:44.586571 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-b7c3e4e6-5798-4c2d-9d5b-311ca3787f32 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Getting quotas for project 054a41c637b243f180a79969432bb3f8. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:17:44.592517 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-b7c3e4e6-5798-4c2d-9d5b-311ca3787f32 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Getting quotas for user 0143621344994e29b232c9e35c25d427 and project 054a41c637b243f180a79969432bb3f8. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:17:44.641664 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b7c3e4e6-5798-4c2d-9d5b-311ca3787f32 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.114350 Jun 21 08:17:44.643200 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 161/328] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 08:17:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:17:44.703648 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-365604093", "imageRef": "18996821-b0b6-4469-b041-a3ff23f5fa50", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-815556871", "networks": [{"uuid": "ad93e950-a35b-4ca6-b8fc-75dbda938a47"}]}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:44.769018 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] validate_networks() for [('ad93e950-a35b-4ca6-b8fc-75dbda938a47', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:17:44.889450 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-418ef25d-c736-488a-8d63-0f58ac9e28d3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:44.890787 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-418ef25d-c736-488a-8d63-0f58ac9e28d3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:44.901170 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-418ef25d-c736-488a-8d63-0f58ac9e28d3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:44.902794 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-418ef25d-c736-488a-8d63-0f58ac9e28d3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:44.905149 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-418ef25d-c736-488a-8d63-0f58ac9e28d3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:44.907117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-418ef25d-c736-488a-8d63-0f58ac9e28d3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:45.095380 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-418ef25d-c736-488a-8d63-0f58ac9e28d3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:45.107943 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-418ef25d-c736-488a-8d63-0f58ac9e28d3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.222787 Jun 21 08:17:45.109162 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 162/329] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:44 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:45.113951 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5993fa57-15a5-4088-ab6b-fd6faf25f9e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:45.121535 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5993fa57-15a5-4088-ab6b-fd6faf25f9e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:45.122106 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5993fa57-15a5-4088-ab6b-fd6faf25f9e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:45.211758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:17:45.212859 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:17:45.214674 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:17:45.215720 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:17:45.216483 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:17:45.230899 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:45.232116 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:45.233060 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:45.234201 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:45.244956 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5993fa57-15a5-4088-ab6b-fd6faf25f9e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Going to try to stop instance {{(pid=117548) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 08:17:45.256296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Getting quotas for project 054a41c637b243f180a79969432bb3f8. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:17:45.260420 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Getting quotas for user 0143621344994e29b232c9e35c25d427 and project 054a41c637b243f180a79969432bb3f8. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:17:45.273016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:17:45.276954 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18996821-b0b6-4469-b041-a3ff23f5fa50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:17:45.304931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5993fa57-15a5-4088-ab6b-fd6faf25f9e8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/action" status: 202 len: 0 microversion: 2.1 time: 0.194307 Jun 21 08:17:45.305692 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 163/330] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:17:45 2022] POST /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:17:45.316564 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-056394d7-d478-434f-9293-aef4fea27931 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:45.317778 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-056394d7-d478-434f-9293-aef4fea27931 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:45.325417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-056394d7-d478-434f-9293-aef4fea27931 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:45.326406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-056394d7-d478-434f-9293-aef4fea27931 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:45.327439 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-056394d7-d478-434f-9293-aef4fea27931 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:45.327872 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-056394d7-d478-434f-9293-aef4fea27931 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:45.332968 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ae9749ac-c4d9-4020-8e06-6af47ea85155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634033 Jun 21 08:17:45.334445 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 168/331] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:17:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:17:45.347023 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5425ce4c-8057-41cf-a7d1-1be78e6fc492 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:45.347974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5425ce4c-8057-41cf-a7d1-1be78e6fc492 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:45.428512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5425ce4c-8057-41cf-a7d1-1be78e6fc492 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:45.452868 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5425ce4c-8057-41cf-a7d1-1be78e6fc492 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1257 microversion: 2.1 time: 0.111332 Jun 21 08:17:45.469249 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 169/332] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:45 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1257 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:45.474238 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-501c1fe6-30c7-42b3-9fb8-8175b8830f5e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:45.474888 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-501c1fe6-30c7-42b3-9fb8-8175b8830f5e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:45.490210 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-501c1fe6-30c7-42b3-9fb8-8175b8830f5e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:45.490669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-501c1fe6-30c7-42b3-9fb8-8175b8830f5e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:45.497705 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-501c1fe6-30c7-42b3-9fb8-8175b8830f5e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:45.498161 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-501c1fe6-30c7-42b3-9fb8-8175b8830f5e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:45.582552 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-056394d7-d478-434f-9293-aef4fea27931 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:45.593383 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-056394d7-d478-434f-9293-aef4fea27931 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.282358 Jun 21 08:17:45.595331 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 164/333] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:45 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:45.685391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-501c1fe6-30c7-42b3-9fb8-8175b8830f5e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:45.693968 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-501c1fe6-30c7-42b3-9fb8-8175b8830f5e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.223563 Jun 21 08:17:45.695524 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 170/334] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:45 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:46.126147 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a43eda3f-8ef6-44b7-aad8-a893e669527f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:46.126792 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a43eda3f-8ef6-44b7-aad8-a893e669527f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:46.135347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a43eda3f-8ef6-44b7-aad8-a893e669527f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:46.135800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a43eda3f-8ef6-44b7-aad8-a893e669527f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:46.136800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a43eda3f-8ef6-44b7-aad8-a893e669527f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:46.137231 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a43eda3f-8ef6-44b7-aad8-a893e669527f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:46.283194 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a43eda3f-8ef6-44b7-aad8-a893e669527f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:46.290930 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a43eda3f-8ef6-44b7-aad8-a893e669527f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.169464 Jun 21 08:17:46.291670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 165/335] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:46 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:46.473090 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1d0c6af9-6051-4c3e-957b-83a46443a347 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:46.473704 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1d0c6af9-6051-4c3e-957b-83a46443a347 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:46.480173 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1d0c6af9-6051-4c3e-957b-83a46443a347 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:46.480647 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1d0c6af9-6051-4c3e-957b-83a46443a347 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:46.481399 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1d0c6af9-6051-4c3e-957b-83a46443a347 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:46.481822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1d0c6af9-6051-4c3e-957b-83a46443a347 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:46.542772 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1d0c6af9-6051-4c3e-957b-83a46443a347 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:46.550443 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1d0c6af9-6051-4c3e-957b-83a46443a347 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1261 microversion: 2.1 time: 0.081247 Jun 21 08:17:46.551019 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 171/336] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:46 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:46.612830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3d218556-5845-4f9a-9b00-33a8d350519a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:46.613448 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3d218556-5845-4f9a-9b00-33a8d350519a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:46.620109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3d218556-5845-4f9a-9b00-33a8d350519a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:46.620557 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3d218556-5845-4f9a-9b00-33a8d350519a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:46.621348 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3d218556-5845-4f9a-9b00-33a8d350519a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:46.621780 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3d218556-5845-4f9a-9b00-33a8d350519a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:46.711665 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-879d502f-b04e-47d2-ae76-dcfe9d2ab956 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:46.712360 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-879d502f-b04e-47d2-ae76-dcfe9d2ab956 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:46.718991 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-879d502f-b04e-47d2-ae76-dcfe9d2ab956 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:46.719514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-879d502f-b04e-47d2-ae76-dcfe9d2ab956 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:46.720343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-879d502f-b04e-47d2-ae76-dcfe9d2ab956 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:46.720844 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-879d502f-b04e-47d2-ae76-dcfe9d2ab956 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:46.756270 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3d218556-5845-4f9a-9b00-33a8d350519a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:46.764144 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3d218556-5845-4f9a-9b00-33a8d350519a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.155760 Jun 21 08:17:46.764898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 166/337] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:46 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:46.855337 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-879d502f-b04e-47d2-ae76-dcfe9d2ab956 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:46.863319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-879d502f-b04e-47d2-ae76-dcfe9d2ab956 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.155422 Jun 21 08:17:46.863907 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 172/338] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:46 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:47.308608 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9bb44a3e-e4ae-4cf6-8f4b-db2732be02bf tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:47.309212 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-9bb44a3e-e4ae-4cf6-8f4b-db2732be02bf tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:47.315267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9bb44a3e-e4ae-4cf6-8f4b-db2732be02bf tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:47.315708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9bb44a3e-e4ae-4cf6-8f4b-db2732be02bf tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:47.316453 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9bb44a3e-e4ae-4cf6-8f4b-db2732be02bf tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:47.316874 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9bb44a3e-e4ae-4cf6-8f4b-db2732be02bf tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:47.449749 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-9bb44a3e-e4ae-4cf6-8f4b-db2732be02bf tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:47.457818 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9bb44a3e-e4ae-4cf6-8f4b-db2732be02bf tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.152927 Jun 21 08:17:47.458390 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 167/339] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:47 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:47.567677 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-682d208d-c635-42c9-943b-81a342387264 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:47.568295 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-682d208d-c635-42c9-943b-81a342387264 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:47.574366 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-682d208d-c635-42c9-943b-81a342387264 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:47.574905 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-682d208d-c635-42c9-943b-81a342387264 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:47.575670 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-682d208d-c635-42c9-943b-81a342387264 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:47.576110 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-682d208d-c635-42c9-943b-81a342387264 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:47.638819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-682d208d-c635-42c9-943b-81a342387264 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:47.646951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-682d208d-c635-42c9-943b-81a342387264 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1261 microversion: 2.1 time: 0.083117 Jun 21 08:17:47.647511 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 173/340] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:47 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:47.781507 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-15986910-8b6e-4a60-9e24-fcceaebaec41 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:47.782115 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-15986910-8b6e-4a60-9e24-fcceaebaec41 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:47.789735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-15986910-8b6e-4a60-9e24-fcceaebaec41 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:47.790177 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-15986910-8b6e-4a60-9e24-fcceaebaec41 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:47.790971 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-15986910-8b6e-4a60-9e24-fcceaebaec41 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:47.791403 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-15986910-8b6e-4a60-9e24-fcceaebaec41 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:47.795462 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:47.881123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-85bf8b5e-217c-432c-94b6-ee6d7886da34 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:47.881740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-85bf8b5e-217c-432c-94b6-ee6d7886da34 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:47.887781 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85bf8b5e-217c-432c-94b6-ee6d7886da34 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:47.888418 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85bf8b5e-217c-432c-94b6-ee6d7886da34 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:47.889365 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85bf8b5e-217c-432c-94b6-ee6d7886da34 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:47.890247 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85bf8b5e-217c-432c-94b6-ee6d7886da34 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:47.930824 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-15986910-8b6e-4a60-9e24-fcceaebaec41 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:47.939654 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-15986910-8b6e-4a60-9e24-fcceaebaec41 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.162299 Jun 21 08:17:47.940277 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 168/341] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:47 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:48.017017 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-85bf8b5e-217c-432c-94b6-ee6d7886da34 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:48.024307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-85bf8b5e-217c-432c-94b6-ee6d7886da34 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.147036 Jun 21 08:17:48.024862 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 174/342] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:47 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:48.475871 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-780551b1-2d6e-4c08-a43b-5c585aff32dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:48.476486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-780551b1-2d6e-4c08-a43b-5c585aff32dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:48.482459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-780551b1-2d6e-4c08-a43b-5c585aff32dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:48.482952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-780551b1-2d6e-4c08-a43b-5c585aff32dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:48.484350 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-780551b1-2d6e-4c08-a43b-5c585aff32dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:48.484921 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-780551b1-2d6e-4c08-a43b-5c585aff32dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:48.613359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-780551b1-2d6e-4c08-a43b-5c585aff32dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:48.620743 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-780551b1-2d6e-4c08-a43b-5c585aff32dc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.149511 Jun 21 08:17:48.621297 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 169/343] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:48 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:48.664042 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-678c6257-7906-49ff-ae34-7fb6b5357ad1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:48.664656 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-678c6257-7906-49ff-ae34-7fb6b5357ad1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:48.666545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:48.671873 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-678c6257-7906-49ff-ae34-7fb6b5357ad1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:48.672319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-678c6257-7906-49ff-ae34-7fb6b5357ad1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:48.673077 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-678c6257-7906-49ff-ae34-7fb6b5357ad1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:48.673511 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-678c6257-7906-49ff-ae34-7fb6b5357ad1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:48.733671 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-678c6257-7906-49ff-ae34-7fb6b5357ad1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:48.744369 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-678c6257-7906-49ff-ae34-7fb6b5357ad1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1261 microversion: 2.1 time: 0.084083 Jun 21 08:17:48.745268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 175/344] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:48 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:48.957117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-aae17c9e-5e21-4010-8da8-9e733bdf654d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:48.957795 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-aae17c9e-5e21-4010-8da8-9e733bdf654d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:48.964429 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aae17c9e-5e21-4010-8da8-9e733bdf654d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:48.964872 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aae17c9e-5e21-4010-8da8-9e733bdf654d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:48.965619 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aae17c9e-5e21-4010-8da8-9e733bdf654d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:48.966047 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aae17c9e-5e21-4010-8da8-9e733bdf654d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:49.041129 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b7d03a03-477b-4007-9c89-0d3f02a3d58e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:49.041661 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b7d03a03-477b-4007-9c89-0d3f02a3d58e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:49.047995 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b7d03a03-477b-4007-9c89-0d3f02a3d58e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:49.048445 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b7d03a03-477b-4007-9c89-0d3f02a3d58e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:49.049207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b7d03a03-477b-4007-9c89-0d3f02a3d58e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:49.049642 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b7d03a03-477b-4007-9c89-0d3f02a3d58e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:49.094218 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-aae17c9e-5e21-4010-8da8-9e733bdf654d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:49.102063 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-aae17c9e-5e21-4010-8da8-9e733bdf654d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.148866 Jun 21 08:17:49.102644 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 170/345] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:48 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:49.180332 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b7d03a03-477b-4007-9c89-0d3f02a3d58e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:49.183758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:49.188552 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b7d03a03-477b-4007-9c89-0d3f02a3d58e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.151402 Jun 21 08:17:49.189105 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 176/346] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:49 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:49.637166 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-00d737bd-7deb-4dc2-a5df-36d268da56c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:49.637780 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-00d737bd-7deb-4dc2-a5df-36d268da56c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:49.644689 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-00d737bd-7deb-4dc2-a5df-36d268da56c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:49.645140 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-00d737bd-7deb-4dc2-a5df-36d268da56c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:49.645898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-00d737bd-7deb-4dc2-a5df-36d268da56c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:49.646328 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-00d737bd-7deb-4dc2-a5df-36d268da56c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:49.761424 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1a333b50-4cd6-4fd5-a782-4024783ad329 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:49.762036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1a333b50-4cd6-4fd5-a782-4024783ad329 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:49.768862 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1a333b50-4cd6-4fd5-a782-4024783ad329 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:49.769311 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1a333b50-4cd6-4fd5-a782-4024783ad329 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:49.770072 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1a333b50-4cd6-4fd5-a782-4024783ad329 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:49.770502 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1a333b50-4cd6-4fd5-a782-4024783ad329 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:49.774882 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-00d737bd-7deb-4dc2-a5df-36d268da56c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:49.782303 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-00d737bd-7deb-4dc2-a5df-36d268da56c3 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.149035 Jun 21 08:17:49.783080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 171/347] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:49 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:49.841481 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1a333b50-4cd6-4fd5-a782-4024783ad329 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:49.849393 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1a333b50-4cd6-4fd5-a782-4024783ad329 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1261 microversion: 2.1 time: 0.091929 Jun 21 08:17:49.849959 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 177/348] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:49 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:50.119184 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-dd53495f-f1c2-41c3-9b74-2de8da920981 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:50.119821 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-dd53495f-f1c2-41c3-9b74-2de8da920981 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:50.127763 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dd53495f-f1c2-41c3-9b74-2de8da920981 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:50.128213 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dd53495f-f1c2-41c3-9b74-2de8da920981 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:50.128978 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dd53495f-f1c2-41c3-9b74-2de8da920981 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:50.129426 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dd53495f-f1c2-41c3-9b74-2de8da920981 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:50.205407 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ef3a5370-27ec-40eb-8832-d248ff02ea76 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:50.206011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ef3a5370-27ec-40eb-8832-d248ff02ea76 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:50.211886 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef3a5370-27ec-40eb-8832-d248ff02ea76 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:50.212332 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef3a5370-27ec-40eb-8832-d248ff02ea76 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:50.213089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef3a5370-27ec-40eb-8832-d248ff02ea76 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:50.213563 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef3a5370-27ec-40eb-8832-d248ff02ea76 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:50.271838 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-dd53495f-f1c2-41c3-9b74-2de8da920981 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:50.291785 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-dd53495f-f1c2-41c3-9b74-2de8da920981 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.176436 Jun 21 08:17:50.292369 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 172/349] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:50 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:50.363447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ef3a5370-27ec-40eb-8832-d248ff02ea76 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:50.372567 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ef3a5370-27ec-40eb-8832-d248ff02ea76 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.171041 Jun 21 08:17:50.373638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 178/350] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:50 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:50.800028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a209a3a3-24de-43de-ab6c-784651518983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:50.800649 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a209a3a3-24de-43de-ab6c-784651518983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:50.806753 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a209a3a3-24de-43de-ab6c-784651518983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:50.807205 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a209a3a3-24de-43de-ab6c-784651518983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:50.807978 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a209a3a3-24de-43de-ab6c-784651518983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:50.808409 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a209a3a3-24de-43de-ab6c-784651518983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:50.868194 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-761acc59-e033-42b6-8167-2c381d9ba9a9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:50.868818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-761acc59-e033-42b6-8167-2c381d9ba9a9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:50.879638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-761acc59-e033-42b6-8167-2c381d9ba9a9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:50.880297 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-761acc59-e033-42b6-8167-2c381d9ba9a9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:50.881086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-761acc59-e033-42b6-8167-2c381d9ba9a9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:50.881776 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-761acc59-e033-42b6-8167-2c381d9ba9a9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:50.953554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-761acc59-e033-42b6-8167-2c381d9ba9a9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:50.961395 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-761acc59-e033-42b6-8167-2c381d9ba9a9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1309 microversion: 2.1 time: 0.097881 Jun 21 08:17:50.961960 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a209a3a3-24de-43de-ab6c-784651518983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:50.962497 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 179/351] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:50 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:50.975405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a209a3a3-24de-43de-ab6c-784651518983 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.179885 Jun 21 08:17:50.975978 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 173/352] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:50 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:51.309184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b12afb2e-ba34-44e6-9002-f6d08a60521a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:51.309758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b12afb2e-ba34-44e6-9002-f6d08a60521a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:51.316348 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b12afb2e-ba34-44e6-9002-f6d08a60521a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:51.316794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b12afb2e-ba34-44e6-9002-f6d08a60521a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:51.317547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b12afb2e-ba34-44e6-9002-f6d08a60521a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:51.317977 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b12afb2e-ba34-44e6-9002-f6d08a60521a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:51.393166 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b2dafc0f-2c3f-43a2-a523-570436a84b7e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:51.394407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b2dafc0f-2c3f-43a2-a523-570436a84b7e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:51.403919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b2dafc0f-2c3f-43a2-a523-570436a84b7e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:51.404571 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b2dafc0f-2c3f-43a2-a523-570436a84b7e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:51.405345 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b2dafc0f-2c3f-43a2-a523-570436a84b7e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:51.405776 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b2dafc0f-2c3f-43a2-a523-570436a84b7e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:51.458138 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b12afb2e-ba34-44e6-9002-f6d08a60521a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:51.466743 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b12afb2e-ba34-44e6-9002-f6d08a60521a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.161387 Jun 21 08:17:51.467316 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 180/353] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:51 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:51.584045 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b2dafc0f-2c3f-43a2-a523-570436a84b7e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:51.592683 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b2dafc0f-2c3f-43a2-a523-570436a84b7e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.206011 Jun 21 08:17:51.593621 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 174/354] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:51 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:51.981277 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9bb50aee-d628-46e2-97c1-ac06a2094794 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:51.982993 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9bb50aee-d628-46e2-97c1-ac06a2094794 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:51.990883 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9bb50aee-d628-46e2-97c1-ac06a2094794 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:51.991673 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9bb50aee-d628-46e2-97c1-ac06a2094794 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:51.992454 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9bb50aee-d628-46e2-97c1-ac06a2094794 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:51.992896 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9bb50aee-d628-46e2-97c1-ac06a2094794 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:51.994635 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5c8cdb45-5832-4412-b060-ae0c7283aef0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:51.996387 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5c8cdb45-5832-4412-b060-ae0c7283aef0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:52.008436 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5c8cdb45-5832-4412-b060-ae0c7283aef0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:52.009317 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5c8cdb45-5832-4412-b060-ae0c7283aef0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:52.010343 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5c8cdb45-5832-4412-b060-ae0c7283aef0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:52.011082 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5c8cdb45-5832-4412-b060-ae0c7283aef0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:52.074303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9bb50aee-d628-46e2-97c1-ac06a2094794 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:52.084045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9bb50aee-d628-46e2-97c1-ac06a2094794 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1315 microversion: 2.1 time: 0.108251 Jun 21 08:17:52.095279 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 181/355] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:51 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1315 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:52.114818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1363663948", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1346110402", "security_groups": [{"name": "tempest-secgroup-smoke-1570178960"}], "networks": [{"uuid": "4fd63f41-0b64-457a-a459-a1cb3fc5b891"}], "block_device_mapping_v2": [{"uuid": "6111f545-81cb-4158-88c5-818c7fe47dd9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:52.264525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] validate_networks() for [('4fd63f41-0b64-457a-a459-a1cb3fc5b891', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:17:52.303490 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5c8cdb45-5832-4412-b060-ae0c7283aef0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:52.312126 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5c8cdb45-5832-4412-b060-ae0c7283aef0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1501 microversion: 2.1 time: 0.322505 Jun 21 08:17:52.312703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 175/356] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:51 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1501 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:52.329707 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-837291be-e1a9-4bba-9858-68a6e9f3df25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c065cf13-860c-465a-9ac8-6fb761cb5831"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:52.331112 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-837291be-e1a9-4bba-9858-68a6e9f3df25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:52.337378 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-837291be-e1a9-4bba-9858-68a6e9f3df25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:52.337940 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-837291be-e1a9-4bba-9858-68a6e9f3df25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:52.338918 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-837291be-e1a9-4bba-9858-68a6e9f3df25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:52.339649 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-837291be-e1a9-4bba-9858-68a6e9f3df25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:52.390061 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-837291be-e1a9-4bba-9858-68a6e9f3df25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] HTTP exception thrown: Cannot 'attach_volume' instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc while it is in vm_state rescued Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-837291be-e1a9-4bba-9858-68a6e9f3df25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Request method failure captured: Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: POST /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc/os-volume_attachments HTTP/1.1 Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 74 Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4kw49eR-vbnBBhtDk_dfaC58ianxrNvQU-ghNVYEt5aSDOdJQr6rzlG7AbzaYFlP3Nx37QATSOBYxXOIuAPPLyANNgQF2TidMGs6Ceo68Tpl0m1pqj9Lyuaz61drO8mnz15JVyHEo6wXUzhlesQAyQT3WzfUYYe3uqvIbFIo_3ZzA Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 2001b029fae0472d8ef7b6fd658ad191 Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:17:52.392512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2001b029fae0472d8ef7b6fd658ad191", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 2001b029fae0472d8ef7b6fd658ad191 Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-ServerRescueNegativeTestJSON-1558605599-project Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 771f36afce0a4dd8897bb22f3c330856 Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1558605599-project Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {"volumeAttachment": {"volumeId": "c065cf13-860c-465a-9ac8-6fb761cb5831"}} Jun 21 08:17:52.395186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Cannot 'attach_volume' instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc while it is in vm_state rescued Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'server_id': 'ebe8e00a-97d1-4e7c-8a02-db6a981670fc', 'body': {'volumeAttachment': {'volumeId': 'c065cf13-860c-465a-9ac8-6fb761cb5831'}}} Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:17:52.396391 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc while it is in vm_state rescued Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:17:52.398347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:17:52.400487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:17:52.400487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:17:52.400487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc while it is in vm_state rescued Jun 21 08:17:52.400487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:17:52.400487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-837291be-e1a9-4bba-9858-68a6e9f3df25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Returning 409 to user: Cannot 'attach_volume' instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc while it is in vm_state rescued {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:17:52.400487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-837291be-e1a9-4bba-9858-68a6e9f3df25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.068867 Jun 21 08:17:52.400487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 176/357] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:17:52 2022] POST /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 21 08:17:52.403485 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-351120e4-39d4-48db-930d-58bcb1ae0632 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:52.404015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-351120e4-39d4-48db-930d-58bcb1ae0632 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:52.417300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-351120e4-39d4-48db-930d-58bcb1ae0632 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:52.417827 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-351120e4-39d4-48db-930d-58bcb1ae0632 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:52.418992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-351120e4-39d4-48db-930d-58bcb1ae0632 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:52.419507 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-351120e4-39d4-48db-930d-58bcb1ae0632 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:52.526113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-351120e4-39d4-48db-930d-58bcb1ae0632 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc/action" status: 202 len: 0 microversion: 2.1 time: 0.126438 Jun 21 08:17:52.531580 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 177/358] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:17:52 2022] POST /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:17:52.553930 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-edab3099-c562-4c38-a94d-e1060df6739e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:52.557336 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-edab3099-c562-4c38-a94d-e1060df6739e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:52.600479 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-edab3099-c562-4c38-a94d-e1060df6739e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:52.601160 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-edab3099-c562-4c38-a94d-e1060df6739e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:52.602097 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-edab3099-c562-4c38-a94d-e1060df6739e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:52.605117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-edab3099-c562-4c38-a94d-e1060df6739e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:53.089840 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-edab3099-c562-4c38-a94d-e1060df6739e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:53.101751 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-edab3099-c562-4c38-a94d-e1060df6739e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.567519 Jun 21 08:17:53.102589 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 178/359] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:52 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:53.111907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5b5d8a1f-fb2f-45fd-9a73-d89c84c3eea8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:53.114441 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5b5d8a1f-fb2f-45fd-9a73-d89c84c3eea8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:53.129134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5b5d8a1f-fb2f-45fd-9a73-d89c84c3eea8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:53.133739 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5b5d8a1f-fb2f-45fd-9a73-d89c84c3eea8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:53.134772 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5b5d8a1f-fb2f-45fd-9a73-d89c84c3eea8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:53.135285 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5b5d8a1f-fb2f-45fd-9a73-d89c84c3eea8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:53.420205 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5b5d8a1f-fb2f-45fd-9a73-d89c84c3eea8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:53.434104 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5b5d8a1f-fb2f-45fd-9a73-d89c84c3eea8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1509 microversion: 2.1 time: 0.330064 Jun 21 08:17:53.435499 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 179/360] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:53 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:53.441567 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a02a7b16-a659-45d4-8117-91642f91f0fc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:53.442374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a02a7b16-a659-45d4-8117-91642f91f0fc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:53.468210 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a02a7b16-a659-45d4-8117-91642f91f0fc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:53.468829 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a02a7b16-a659-45d4-8117-91642f91f0fc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:53.469110 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:17:53.469562 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:17:53.470032 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:17:53.470600 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:17:53.471066 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:17:53.471753 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a02a7b16-a659-45d4-8117-91642f91f0fc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:53.472202 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a02a7b16-a659-45d4-8117-91642f91f0fc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:53.483202 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:53.483697 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:53.489256 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:53.489735 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:53.546294 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Getting quotas for project cad2999c58284b92b7166848a3e1f261. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:17:53.555578 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Getting quotas for user 8b54a55cff584d948b96c1c439e57eda and project cad2999c58284b92b7166848a3e1f261. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:17:53.732379 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:17:53.734859 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6111f545-81cb-4158-88c5-818c7fe47dd9',volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:17:54.000176 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9ef52eae-ac40-46ad-b806-34f6266b423f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.889743 Jun 21 08:17:54.004601 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 182/361] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:17:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:17:54.025942 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-eec9b30c-9065-4665-ab7a-a2d17cccf3b1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:54.027349 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-eec9b30c-9065-4665-ab7a-a2d17cccf3b1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:54.056045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eec9b30c-9065-4665-ab7a-a2d17cccf3b1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:54.056774 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eec9b30c-9065-4665-ab7a-a2d17cccf3b1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:54.061131 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eec9b30c-9065-4665-ab7a-a2d17cccf3b1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:54.062172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eec9b30c-9065-4665-ab7a-a2d17cccf3b1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:54.348036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-eec9b30c-9065-4665-ab7a-a2d17cccf3b1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:54.371425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-eec9b30c-9065-4665-ab7a-a2d17cccf3b1 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.363448 Jun 21 08:17:54.371425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 183/362] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:54 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:54.394111 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dcaac8fb-3c55-4913-b541-472564bd365a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:54.395081 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-dcaac8fb-3c55-4913-b541-472564bd365a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:54.542072 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-dcaac8fb-3c55-4913-b541-472564bd365a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:54.554884 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-dcaac8fb-3c55-4913-b541-472564bd365a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1089 microversion: 2.1 time: 0.173159 Jun 21 08:17:54.558113 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 184/363] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:54 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1089 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:54.563794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-23e0bc43-3c86-4d38-8d9d-d28d45c52495 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:54.564669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-23e0bc43-3c86-4d38-8d9d-d28d45c52495 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:54.604923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=4 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:54.635867 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-23e0bc43-3c86-4d38-8d9d-d28d45c52495 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:54.636307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-23e0bc43-3c86-4d38-8d9d-d28d45c52495 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:54.643753 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-23e0bc43-3c86-4d38-8d9d-d28d45c52495 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:54.648024 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-23e0bc43-3c86-4d38-8d9d-d28d45c52495 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:54.792149 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a02a7b16-a659-45d4-8117-91642f91f0fc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:54.809509 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a02a7b16-a659-45d4-8117-91642f91f0fc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 1.372562 Jun 21 08:17:54.823396 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 180/364] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:53 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:54.833722 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-faee11e6-6c9f-4fc3-90f1-d046bbd20dea req-960e9408-e346-435d-b219-d1d59c570834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6909a083-0588-4b06-916a-e9b153960ffa", "name": "network-vif-plugged", "status": "completed", "tag": "b38df0c4-4ff4-4131-becf-c141ab0b4a03"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:54.837855 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:54.881368 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-faee11e6-6c9f-4fc3-90f1-d046bbd20dea req-960e9408-e346-435d-b219-d1d59c570834 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:54.881827 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-faee11e6-6c9f-4fc3-90f1-d046bbd20dea req-960e9408-e346-435d-b219-d1d59c570834 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:54.929605 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-faee11e6-6c9f-4fc3-90f1-d046bbd20dea req-960e9408-e346-435d-b219-d1d59c570834 service nova] Creating event network-vif-plugged:b38df0c4-4ff4-4131-becf-c141ab0b4a03 for instance 6909a083-0588-4b06-916a-e9b153960ffa on hv-cinder-83697 Jun 21 08:17:54.948175 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-faee11e6-6c9f-4fc3-90f1-d046bbd20dea req-960e9408-e346-435d-b219-d1d59c570834 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130217 Jun 21 08:17:54.971312 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 181/365] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:17:54.993220 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-23e0bc43-3c86-4d38-8d9d-d28d45c52495 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:54.997341 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e6165700-44fd-4a3c-9ecb-efaef5fad461 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:55.003516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e6165700-44fd-4a3c-9ecb-efaef5fad461 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:55.007680 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-23e0bc43-3c86-4d38-8d9d-d28d45c52495 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.448149 Jun 21 08:17:55.008491 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 185/366] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:54 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:55.027380 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e6165700-44fd-4a3c-9ecb-efaef5fad461 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:55.038006 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e6165700-44fd-4a3c-9ecb-efaef5fad461 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:55.038879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e6165700-44fd-4a3c-9ecb-efaef5fad461 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:55.039478 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e6165700-44fd-4a3c-9ecb-efaef5fad461 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:55.402106 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fc2da2b0-a9f2-4f3b-8e21-f6e585f1aeaf tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:55.403993 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fc2da2b0-a9f2-4f3b-8e21-f6e585f1aeaf tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:55.437459 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fc2da2b0-a9f2-4f3b-8e21-f6e585f1aeaf tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:55.440320 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fc2da2b0-a9f2-4f3b-8e21-f6e585f1aeaf tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:55.446052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fc2da2b0-a9f2-4f3b-8e21-f6e585f1aeaf tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:55.446884 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fc2da2b0-a9f2-4f3b-8e21-f6e585f1aeaf tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:55.616167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fc2da2b0-a9f2-4f3b-8e21-f6e585f1aeaf tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:55.627486 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fc2da2b0-a9f2-4f3b-8e21-f6e585f1aeaf tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.236594 Jun 21 08:17:55.629731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 186/367] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:55 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:55.635031 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-be1eb9b2-5cd4-4c33-9b71-3a523ab62ff7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:55.635877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-be1eb9b2-5cd4-4c33-9b71-3a523ab62ff7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:55.660322 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-be1eb9b2-5cd4-4c33-9b71-3a523ab62ff7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:55.661034 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-be1eb9b2-5cd4-4c33-9b71-3a523ab62ff7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:55.663023 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-be1eb9b2-5cd4-4c33-9b71-3a523ab62ff7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:55.664195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-be1eb9b2-5cd4-4c33-9b71-3a523ab62ff7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:55.759760 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-be1eb9b2-5cd4-4c33-9b71-3a523ab62ff7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:55.775463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-be1eb9b2-5cd4-4c33-9b71-3a523ab62ff7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1139 microversion: 2.1 time: 0.144096 Jun 21 08:17:55.785709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 187/368] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:55 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1139 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:55.846836 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b010c810-646e-43da-b598-10dc9c785eb0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:55.848580 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b010c810-646e-43da-b598-10dc9c785eb0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:55.857131 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b010c810-646e-43da-b598-10dc9c785eb0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:55.858430 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b010c810-646e-43da-b598-10dc9c785eb0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:55.859904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b010c810-646e-43da-b598-10dc9c785eb0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:55.862027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b010c810-646e-43da-b598-10dc9c785eb0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:56.023906 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e6165700-44fd-4a3c-9ecb-efaef5fad461 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:56.040330 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e6165700-44fd-4a3c-9ecb-efaef5fad461 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1509 microversion: 2.1 time: 1.067358 Jun 21 08:17:56.041159 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 182/369] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:54 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1509 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:56.053908 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9ea67ab8-032d-401a-a654-3335daa4b262 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:56.056888 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-9ea67ab8-032d-401a-a654-3335daa4b262 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:56.065406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9ea67ab8-032d-401a-a654-3335daa4b262 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:56.066084 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9ea67ab8-032d-401a-a654-3335daa4b262 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:56.067057 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9ea67ab8-032d-401a-a654-3335daa4b262 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:56.067638 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9ea67ab8-032d-401a-a654-3335daa4b262 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:56.129808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b010c810-646e-43da-b598-10dc9c785eb0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:56.139911 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b010c810-646e-43da-b598-10dc9c785eb0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.299710 Jun 21 08:17:56.149898 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 188/370] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:55 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:17:56.483542 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-9ea67ab8-032d-401a-a654-3335daa4b262 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:56.493116 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9ea67ab8-032d-401a-a654-3335daa4b262 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.450535 Jun 21 08:17:56.493728 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 183/371] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:56 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:56.627008 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-ea06a2c7-c54c-4062-987e-60bc5c6ca8c0 req-0c464f2e-8d15-4d55-8b4e-f555f7c0d8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32533add-63db-4d29-9be0-09f5ec2c39b3", "tag": "caad30cb-6338-4d28-a42e-d858cceaec6f"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:17:56.641919 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-ea06a2c7-c54c-4062-987e-60bc5c6ca8c0 req-0c464f2e-8d15-4d55-8b4e-f555f7c0d8d0 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:56.642944 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-ea06a2c7-c54c-4062-987e-60bc5c6ca8c0 req-0c464f2e-8d15-4d55-8b4e-f555f7c0d8d0 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:56.645836 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2e7440ec-53df-421f-9ea5-010560473e75 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:56.646461 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2e7440ec-53df-421f-9ea5-010560473e75 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:56.660302 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-ea06a2c7-c54c-4062-987e-60bc5c6ca8c0 req-0c464f2e-8d15-4d55-8b4e-f555f7c0d8d0 service nova] Creating event network-changed:caad30cb-6338-4d28-a42e-d858cceaec6f for instance 32533add-63db-4d29-9be0-09f5ec2c39b3 on hv-cinder-83697 Jun 21 08:17:56.666963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-ea06a2c7-c54c-4062-987e-60bc5c6ca8c0 req-0c464f2e-8d15-4d55-8b4e-f555f7c0d8d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044799 Jun 21 08:17:56.667138 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2e7440ec-53df-421f-9ea5-010560473e75 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:56.667517 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2e7440ec-53df-421f-9ea5-010560473e75 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:56.668292 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2e7440ec-53df-421f-9ea5-010560473e75 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:56.668616 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 189/372] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:17:56.678455 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2e7440ec-53df-421f-9ea5-010560473e75 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:56.799704 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f736721c-e7f0-4b1b-9d33-6d84dd7a69e1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:56.800529 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f736721c-e7f0-4b1b-9d33-6d84dd7a69e1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:56.821365 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f736721c-e7f0-4b1b-9d33-6d84dd7a69e1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:56.822305 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f736721c-e7f0-4b1b-9d33-6d84dd7a69e1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:56.825741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f736721c-e7f0-4b1b-9d33-6d84dd7a69e1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:56.827147 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f736721c-e7f0-4b1b-9d33-6d84dd7a69e1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:56.936608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f736721c-e7f0-4b1b-9d33-6d84dd7a69e1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:56.953229 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f736721c-e7f0-4b1b-9d33-6d84dd7a69e1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1187 microversion: 2.1 time: 0.164042 Jun 21 08:17:56.964134 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 190/373] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:56 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1187 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:57.014829 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2e7440ec-53df-421f-9ea5-010560473e75 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:57.020340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:57.037637 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2e7440ec-53df-421f-9ea5-010560473e75 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.396146 Jun 21 08:17:57.038557 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 184/374] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:56 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:57.059127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5c4af691-2522-4892-8e3a-f051ee20b08b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:57.059730 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5c4af691-2522-4892-8e3a-f051ee20b08b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:57.070758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c4af691-2522-4892-8e3a-f051ee20b08b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:57.071145 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c4af691-2522-4892-8e3a-f051ee20b08b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:57.078655 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c4af691-2522-4892-8e3a-f051ee20b08b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:57.079477 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c4af691-2522-4892-8e3a-f051ee20b08b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:57.160802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e8fd16b1-7d21-407d-a7ef-c24c7ca4bb4f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:57.161709 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e8fd16b1-7d21-407d-a7ef-c24c7ca4bb4f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:57.177372 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e8fd16b1-7d21-407d-a7ef-c24c7ca4bb4f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:57.178264 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e8fd16b1-7d21-407d-a7ef-c24c7ca4bb4f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:57.179504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e8fd16b1-7d21-407d-a7ef-c24c7ca4bb4f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:57.179961 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e8fd16b1-7d21-407d-a7ef-c24c7ca4bb4f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:57.336408 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5c4af691-2522-4892-8e3a-f051ee20b08b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:57.347646 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5c4af691-2522-4892-8e3a-f051ee20b08b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1509 microversion: 2.1 time: 0.292895 Jun 21 08:17:57.349405 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 191/375] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:57 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:57.422418 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e8fd16b1-7d21-407d-a7ef-c24c7ca4bb4f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:57.433825 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e8fd16b1-7d21-407d-a7ef-c24c7ca4bb4f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.279352 Jun 21 08:17:57.435720 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 185/376] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:57 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:57.514602 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-62e0046a-7a93-4d41-a8d5-faa0bff786da tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:57.515786 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-62e0046a-7a93-4d41-a8d5-faa0bff786da tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:57.527300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-62e0046a-7a93-4d41-a8d5-faa0bff786da tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:57.528153 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-62e0046a-7a93-4d41-a8d5-faa0bff786da tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:57.529362 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-62e0046a-7a93-4d41-a8d5-faa0bff786da tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:57.530012 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-62e0046a-7a93-4d41-a8d5-faa0bff786da tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:57.868553 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-62e0046a-7a93-4d41-a8d5-faa0bff786da tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:57.908503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-62e0046a-7a93-4d41-a8d5-faa0bff786da tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.399296 Jun 21 08:17:57.911480 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 192/377] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:57 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:57.972024 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7b1cb2d2-d11c-4667-a92a-8f14d78a7054 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:57.979135 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-7b1cb2d2-d11c-4667-a92a-8f14d78a7054 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:57.993517 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7b1cb2d2-d11c-4667-a92a-8f14d78a7054 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:57.993517 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7b1cb2d2-d11c-4667-a92a-8f14d78a7054 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:57.998013 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7b1cb2d2-d11c-4667-a92a-8f14d78a7054 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:57.998565 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7b1cb2d2-d11c-4667-a92a-8f14d78a7054 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:58.068138 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-80b1f384-540c-46b6-9efe-e449707f1ab0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:58.068930 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-80b1f384-540c-46b6-9efe-e449707f1ab0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:58.077900 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-80b1f384-540c-46b6-9efe-e449707f1ab0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:58.096177 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-80b1f384-540c-46b6-9efe-e449707f1ab0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:58.096177 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-80b1f384-540c-46b6-9efe-e449707f1ab0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:58.096177 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-80b1f384-540c-46b6-9efe-e449707f1ab0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:58.259975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-7b1cb2d2-d11c-4667-a92a-8f14d78a7054 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:58.289491 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7b1cb2d2-d11c-4667-a92a-8f14d78a7054 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1187 microversion: 2.1 time: 0.322436 Jun 21 08:17:58.299910 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 186/378] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:57 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1187 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:58.339067 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-80b1f384-540c-46b6-9efe-e449707f1ab0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:58.366964 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0d9058e5-661c-4dd6-bdaa-672742463eaa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:58.368266 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0d9058e5-661c-4dd6-bdaa-672742463eaa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:58.375444 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-80b1f384-540c-46b6-9efe-e449707f1ab0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.318116 Jun 21 08:17:58.381963 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0d9058e5-661c-4dd6-bdaa-672742463eaa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:58.382841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0d9058e5-661c-4dd6-bdaa-672742463eaa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:58.383265 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 193/379] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:58 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:58.384143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0d9058e5-661c-4dd6-bdaa-672742463eaa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:58.384791 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0d9058e5-661c-4dd6-bdaa-672742463eaa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:58.453628 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b7db3312-3b26-46dc-86f7-a902bc6c00df tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:58.455665 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b7db3312-3b26-46dc-86f7-a902bc6c00df tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:58.467441 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b7db3312-3b26-46dc-86f7-a902bc6c00df tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:58.470612 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b7db3312-3b26-46dc-86f7-a902bc6c00df tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:58.476962 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b7db3312-3b26-46dc-86f7-a902bc6c00df tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:58.481324 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b7db3312-3b26-46dc-86f7-a902bc6c00df tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:58.642020 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0d9058e5-661c-4dd6-bdaa-672742463eaa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:58.651070 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0d9058e5-661c-4dd6-bdaa-672742463eaa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1509 microversion: 2.1 time: 0.289494 Jun 21 08:17:58.659417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 187/380] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:58 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1509 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:58.707437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b7db3312-3b26-46dc-86f7-a902bc6c00df tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:58.714794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b7db3312-3b26-46dc-86f7-a902bc6c00df tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.266200 Jun 21 08:17:58.715362 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 194/381] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:58 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:58.934432 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d41fc8ad-b489-4994-ac1e-b84a46b595c0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:58.935143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d41fc8ad-b489-4994-ac1e-b84a46b595c0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:58.946655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d41fc8ad-b489-4994-ac1e-b84a46b595c0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:58.948842 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d41fc8ad-b489-4994-ac1e-b84a46b595c0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:58.951429 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d41fc8ad-b489-4994-ac1e-b84a46b595c0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:58.952173 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d41fc8ad-b489-4994-ac1e-b84a46b595c0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:59.212168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d41fc8ad-b489-4994-ac1e-b84a46b595c0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:59.220987 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d41fc8ad-b489-4994-ac1e-b84a46b595c0 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.291752 Jun 21 08:17:59.221999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 188/382] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:58 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:59.308325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f9aa5c4c-40a9-4b0d-b437-f76d036468f5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:59.308930 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f9aa5c4c-40a9-4b0d-b437-f76d036468f5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:59.322261 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f9aa5c4c-40a9-4b0d-b437-f76d036468f5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:59.322769 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f9aa5c4c-40a9-4b0d-b437-f76d036468f5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:59.323710 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f9aa5c4c-40a9-4b0d-b437-f76d036468f5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:59.324296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f9aa5c4c-40a9-4b0d-b437-f76d036468f5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:59.394088 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2197c5c2-308d-4b4f-8745-2dc1ed52e0a0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:59.394727 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2197c5c2-308d-4b4f-8745-2dc1ed52e0a0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:59.405980 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f9aa5c4c-40a9-4b0d-b437-f76d036468f5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:59.410939 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:59.411751 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2197c5c2-308d-4b4f-8745-2dc1ed52e0a0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:59.415675 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2197c5c2-308d-4b4f-8745-2dc1ed52e0a0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:59.416681 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2197c5c2-308d-4b4f-8745-2dc1ed52e0a0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:59.417130 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2197c5c2-308d-4b4f-8745-2dc1ed52e0a0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:59.419503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f9aa5c4c-40a9-4b0d-b437-f76d036468f5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1195 microversion: 2.1 time: 0.115592 Jun 21 08:17:59.420369 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 195/383] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:59 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1195 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:59.612384 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2197c5c2-308d-4b4f-8745-2dc1ed52e0a0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:17:59.631442 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2197c5c2-308d-4b4f-8745-2dc1ed52e0a0 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.242004 Jun 21 08:17:59.634978 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 189/384] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:59 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:17:59.668692 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-faf6d00d-999b-4dcd-862d-2828b724c03b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:59.669606 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-faf6d00d-999b-4dcd-862d-2828b724c03b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:59.677574 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-faf6d00d-999b-4dcd-862d-2828b724c03b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:59.678452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-faf6d00d-999b-4dcd-862d-2828b724c03b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:59.679752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-faf6d00d-999b-4dcd-862d-2828b724c03b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:59.680683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-faf6d00d-999b-4dcd-862d-2828b724c03b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:59.754994 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f9a08e87-7cd6-43b1-a6d5-9531add55eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:17:59.769415 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f9a08e87-7cd6-43b1-a6d5-9531add55eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:17:59.801937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f9a08e87-7cd6-43b1-a6d5-9531add55eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:59.805134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f9a08e87-7cd6-43b1-a6d5-9531add55eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:17:59.807780 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f9a08e87-7cd6-43b1-a6d5-9531add55eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:17:59.809771 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f9a08e87-7cd6-43b1-a6d5-9531add55eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:00.023167 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f9a08e87-7cd6-43b1-a6d5-9531add55eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:00.032513 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f9a08e87-7cd6-43b1-a6d5-9531add55eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.302571 Jun 21 08:18:00.033648 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 190/385] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:59 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:00.052478 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-faf6d00d-999b-4dcd-862d-2828b724c03b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:00.075434 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-faf6d00d-999b-4dcd-862d-2828b724c03b tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1509 microversion: 2.1 time: 0.408584 Jun 21 08:18:00.076451 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 196/386] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:17:59 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:00.242567 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8798fb95-92dc-4d91-9f48-b56d8870ef1c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:00.243592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8798fb95-92dc-4d91-9f48-b56d8870ef1c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:00.250588 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8798fb95-92dc-4d91-9f48-b56d8870ef1c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:00.251138 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8798fb95-92dc-4d91-9f48-b56d8870ef1c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:00.252562 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8798fb95-92dc-4d91-9f48-b56d8870ef1c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:00.253004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8798fb95-92dc-4d91-9f48-b56d8870ef1c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:00.445455 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6cdfd987-72d1-4e29-8698-77326b630c47 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:00.446125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6cdfd987-72d1-4e29-8698-77326b630c47 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:00.461648 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6cdfd987-72d1-4e29-8698-77326b630c47 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:00.462478 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6cdfd987-72d1-4e29-8698-77326b630c47 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:00.463606 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6cdfd987-72d1-4e29-8698-77326b630c47 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:00.466551 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6cdfd987-72d1-4e29-8698-77326b630c47 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:00.517360 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8798fb95-92dc-4d91-9f48-b56d8870ef1c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:00.535366 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8798fb95-92dc-4d91-9f48-b56d8870ef1c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.296303 Jun 21 08:18:00.542501 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 191/387] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:00 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:00.621614 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-6cdfd987-72d1-4e29-8698-77326b630c47 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:00.640478 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6cdfd987-72d1-4e29-8698-77326b630c47 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1195 microversion: 2.1 time: 0.196208 Jun 21 08:18:00.654184 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d3bcfad7-c870-4bf4-ae4d-227ef1ac1e87 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:00.654843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d3bcfad7-c870-4bf4-ae4d-227ef1ac1e87 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:00.659715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 197/388] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:00 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1195 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:00.668231 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3bcfad7-c870-4bf4-ae4d-227ef1ac1e87 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:00.668682 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3bcfad7-c870-4bf4-ae4d-227ef1ac1e87 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:00.669565 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3bcfad7-c870-4bf4-ae4d-227ef1ac1e87 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:00.670020 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3bcfad7-c870-4bf4-ae4d-227ef1ac1e87 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:00.877890 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d3bcfad7-c870-4bf4-ae4d-227ef1ac1e87 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:00.886977 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d3bcfad7-c870-4bf4-ae4d-227ef1ac1e87 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.237231 Jun 21 08:18:00.887931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 192/389] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:00 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:01.049737 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ea2093c1-5bd3-4d26-b908-130560672eff tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:01.050279 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ea2093c1-5bd3-4d26-b908-130560672eff tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:01.073946 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ea2093c1-5bd3-4d26-b908-130560672eff tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:01.074463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ea2093c1-5bd3-4d26-b908-130560672eff tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:01.075585 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ea2093c1-5bd3-4d26-b908-130560672eff tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:01.076156 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ea2093c1-5bd3-4d26-b908-130560672eff tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:01.093454 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-431ce3f8-f2bd-4355-a0dd-dda11246a539 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:01.094131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-431ce3f8-f2bd-4355-a0dd-dda11246a539 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:01.105499 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-431ce3f8-f2bd-4355-a0dd-dda11246a539 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:01.106470 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-431ce3f8-f2bd-4355-a0dd-dda11246a539 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:01.107702 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-431ce3f8-f2bd-4355-a0dd-dda11246a539 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:01.108365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-431ce3f8-f2bd-4355-a0dd-dda11246a539 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:01.336781 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-431ce3f8-f2bd-4355-a0dd-dda11246a539 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:01.341220 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ea2093c1-5bd3-4d26-b908-130560672eff tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:01.347547 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-431ce3f8-f2bd-4355-a0dd-dda11246a539 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1509 microversion: 2.1 time: 0.260576 Jun 21 08:18:01.349048 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 193/390] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:01 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1509 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:01.350764 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ea2093c1-5bd3-4d26-b908-130560672eff tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.305296 Jun 21 08:18:01.362071 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 198/391] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:01 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:01.559907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-cb762a36-b3e3-4445-9c1d-169bc65068dc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:01.560700 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-cb762a36-b3e3-4445-9c1d-169bc65068dc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:01.568514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cb762a36-b3e3-4445-9c1d-169bc65068dc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:01.569222 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cb762a36-b3e3-4445-9c1d-169bc65068dc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:01.570213 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cb762a36-b3e3-4445-9c1d-169bc65068dc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:01.570671 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cb762a36-b3e3-4445-9c1d-169bc65068dc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:01.660146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3a802644-0dd9-4be8-bfe4-622f99bfc33e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:01.660843 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3a802644-0dd9-4be8-bfe4-622f99bfc33e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:01.670818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3a802644-0dd9-4be8-bfe4-622f99bfc33e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:01.671943 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3a802644-0dd9-4be8-bfe4-622f99bfc33e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:01.675247 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3a802644-0dd9-4be8-bfe4-622f99bfc33e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:01.676020 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3a802644-0dd9-4be8-bfe4-622f99bfc33e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:01.792937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-cb762a36-b3e3-4445-9c1d-169bc65068dc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:01.820140 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-cb762a36-b3e3-4445-9c1d-169bc65068dc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.265696 Jun 21 08:18:01.820872 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 194/392] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:01 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:01.833061 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-3a802644-0dd9-4be8-bfe4-622f99bfc33e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:01.840161 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3a802644-0dd9-4be8-bfe4-622f99bfc33e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1195 microversion: 2.1 time: 0.183856 Jun 21 08:18:01.841345 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 199/393] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:01 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1195 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:01.905935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-67a91c0a-8d1e-4fc5-a685-f8bd43a720fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:01.907724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-67a91c0a-8d1e-4fc5-a685-f8bd43a720fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:01.924818 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-67a91c0a-8d1e-4fc5-a685-f8bd43a720fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:01.925272 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-67a91c0a-8d1e-4fc5-a685-f8bd43a720fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:01.926054 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-67a91c0a-8d1e-4fc5-a685-f8bd43a720fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:01.926494 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-67a91c0a-8d1e-4fc5-a685-f8bd43a720fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:02.123268 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-67a91c0a-8d1e-4fc5-a685-f8bd43a720fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:02.138820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-67a91c0a-8d1e-4fc5-a685-f8bd43a720fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.237553 Jun 21 08:18:02.140427 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 195/394] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:01 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:02.371709 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-60915fb5-4579-4a24-a4fc-506b6dd267a4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:02.372037 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-27b6c7ff-0fc8-4f4b-ad81-9d592014fea0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:02.372710 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-27b6c7ff-0fc8-4f4b-ad81-9d592014fea0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:02.373221 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-60915fb5-4579-4a24-a4fc-506b6dd267a4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:02.380551 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-27b6c7ff-0fc8-4f4b-ad81-9d592014fea0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:02.381355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-27b6c7ff-0fc8-4f4b-ad81-9d592014fea0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:02.382630 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-27b6c7ff-0fc8-4f4b-ad81-9d592014fea0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:02.383040 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60915fb5-4579-4a24-a4fc-506b6dd267a4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:02.388153 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60915fb5-4579-4a24-a4fc-506b6dd267a4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:02.388295 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-27b6c7ff-0fc8-4f4b-ad81-9d592014fea0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:02.388397 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60915fb5-4579-4a24-a4fc-506b6dd267a4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:02.388397 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60915fb5-4579-4a24-a4fc-506b6dd267a4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:02.556149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-27b6c7ff-0fc8-4f4b-ad81-9d592014fea0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:02.567655 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-27b6c7ff-0fc8-4f4b-ad81-9d592014fea0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1509 microversion: 2.1 time: 0.205085 Jun 21 08:18:02.568723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 200/395] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:02 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:02.639887 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-60915fb5-4579-4a24-a4fc-506b6dd267a4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:02.648824 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-60915fb5-4579-4a24-a4fc-506b6dd267a4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1367 microversion: 2.1 time: 0.281346 Jun 21 08:18:02.649576 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 196/396] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:02 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:02.841120 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-997717bf-457c-4024-8163-02a50abb388e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:02.841837 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-997717bf-457c-4024-8163-02a50abb388e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:02.848258 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-997717bf-457c-4024-8163-02a50abb388e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:02.848774 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-997717bf-457c-4024-8163-02a50abb388e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:02.849466 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-997717bf-457c-4024-8163-02a50abb388e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:02.849895 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-997717bf-457c-4024-8163-02a50abb388e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:02.857100 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4e43fcaa-41e4-4d38-aef3-9ab83b0f69fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:02.858738 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4e43fcaa-41e4-4d38-aef3-9ab83b0f69fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:02.865862 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e43fcaa-41e4-4d38-aef3-9ab83b0f69fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:02.866325 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e43fcaa-41e4-4d38-aef3-9ab83b0f69fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:02.867128 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e43fcaa-41e4-4d38-aef3-9ab83b0f69fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:02.867740 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4e43fcaa-41e4-4d38-aef3-9ab83b0f69fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:02.934262 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4e43fcaa-41e4-4d38-aef3-9ab83b0f69fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:02.943754 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4e43fcaa-41e4-4d38-aef3-9ab83b0f69fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1195 microversion: 2.1 time: 0.090461 Jun 21 08:18:02.944427 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 197/397] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:02 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1195 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:03.014861 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-997717bf-457c-4024-8163-02a50abb388e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:03.022933 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-997717bf-457c-4024-8163-02a50abb388e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.185788 Jun 21 08:18:03.023536 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 201/398] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:02 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:03.158373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3791795f-2c96-4679-a0e7-e42ad3e73b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:03.159028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3791795f-2c96-4679-a0e7-e42ad3e73b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:03.165133 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3791795f-2c96-4679-a0e7-e42ad3e73b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:03.165586 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3791795f-2c96-4679-a0e7-e42ad3e73b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:03.166359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3791795f-2c96-4679-a0e7-e42ad3e73b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:03.166830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3791795f-2c96-4679-a0e7-e42ad3e73b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:03.334577 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3791795f-2c96-4679-a0e7-e42ad3e73b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:03.352912 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3791795f-2c96-4679-a0e7-e42ad3e73b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.197864 Jun 21 08:18:03.366921 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 198/399] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:03 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:03.587479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3f56b6a3-b762-40bb-9c88-513b8320a0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:03.588097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3f56b6a3-b762-40bb-9c88-513b8320a0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:03.589932 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=4 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:03.597431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3f56b6a3-b762-40bb-9c88-513b8320a0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:03.597985 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3f56b6a3-b762-40bb-9c88-513b8320a0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:03.599185 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3f56b6a3-b762-40bb-9c88-513b8320a0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:03.599637 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3f56b6a3-b762-40bb-9c88-513b8320a0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:03.669021 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-72ed29c2-1440-42ae-9cb6-88f3370895d1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:03.670240 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-72ed29c2-1440-42ae-9cb6-88f3370895d1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:03.677444 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-72ed29c2-1440-42ae-9cb6-88f3370895d1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:03.677874 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-72ed29c2-1440-42ae-9cb6-88f3370895d1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:03.678854 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-72ed29c2-1440-42ae-9cb6-88f3370895d1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:03.679445 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-72ed29c2-1440-42ae-9cb6-88f3370895d1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:03.756360 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-3f56b6a3-b762-40bb-9c88-513b8320a0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:03.764545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3f56b6a3-b762-40bb-9c88-513b8320a0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1509 microversion: 2.1 time: 0.181195 Jun 21 08:18:03.765781 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 202/400] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:03 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:03.849915 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-72ed29c2-1440-42ae-9cb6-88f3370895d1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:03.859789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-72ed29c2-1440-42ae-9cb6-88f3370895d1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1556 microversion: 2.1 time: 0.196898 Jun 21 08:18:03.861526 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 199/401] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:03 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1556 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:03.878499 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-18d50dc8-67e5-4797-baba-d282fdad85f6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:03.879915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-18d50dc8-67e5-4797-baba-d282fdad85f6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:03.887197 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-18d50dc8-67e5-4797-baba-d282fdad85f6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:03.887808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-18d50dc8-67e5-4797-baba-d282fdad85f6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:03.888741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-18d50dc8-67e5-4797-baba-d282fdad85f6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:03.889317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-18d50dc8-67e5-4797-baba-d282fdad85f6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:03.960720 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4c840fa3-fd3c-4843-896f-ce1f07a42094 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:03.961561 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4c840fa3-fd3c-4843-896f-ce1f07a42094 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:03.970159 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4c840fa3-fd3c-4843-896f-ce1f07a42094 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:03.970774 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4c840fa3-fd3c-4843-896f-ce1f07a42094 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:03.971588 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4c840fa3-fd3c-4843-896f-ce1f07a42094 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:03.972091 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4c840fa3-fd3c-4843-896f-ce1f07a42094 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:03.983943 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-18d50dc8-67e5-4797-baba-d282fdad85f6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110595 Jun 21 08:18:03.984672 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 203/402] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 08:18:03 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:04.046913 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0231d19f-f430-430a-baae-393d8f60f9f7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:04.048224 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0231d19f-f430-430a-baae-393d8f60f9f7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:04.054504 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0231d19f-f430-430a-baae-393d8f60f9f7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:04.054995 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0231d19f-f430-430a-baae-393d8f60f9f7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:04.055957 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0231d19f-f430-430a-baae-393d8f60f9f7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:04.056557 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0231d19f-f430-430a-baae-393d8f60f9f7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:04.112287 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4c840fa3-fd3c-4843-896f-ce1f07a42094 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:04.121024 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4c840fa3-fd3c-4843-896f-ce1f07a42094 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1205 microversion: 2.1 time: 0.164486 Jun 21 08:18:04.121701 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 200/403] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:03 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1205 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:04.211869 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0231d19f-f430-430a-baae-393d8f60f9f7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:04.223729 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0231d19f-f430-430a-baae-393d8f60f9f7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.181114 Jun 21 08:18:04.224401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 204/404] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:04 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:04.377869 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f644893d-04a8-4223-9593-5cd88a5b61b6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:04.378482 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f644893d-04a8-4223-9593-5cd88a5b61b6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:04.386435 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f644893d-04a8-4223-9593-5cd88a5b61b6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:04.387057 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f644893d-04a8-4223-9593-5cd88a5b61b6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:04.387840 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f644893d-04a8-4223-9593-5cd88a5b61b6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:04.388271 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f644893d-04a8-4223-9593-5cd88a5b61b6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:04.411994 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=100 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:04.695986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f644893d-04a8-4223-9593-5cd88a5b61b6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:04.707168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f644893d-04a8-4223-9593-5cd88a5b61b6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.333505 Jun 21 08:18:04.708046 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 201/405] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:04 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:04.778077 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=16 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:04.783775 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f923b88d-3fb4-45d3-b3db-e2b215ea7823 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:04.784400 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f923b88d-3fb4-45d3-b3db-e2b215ea7823 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:04.791610 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f923b88d-3fb4-45d3-b3db-e2b215ea7823 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:04.792318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f923b88d-3fb4-45d3-b3db-e2b215ea7823 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:04.793297 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f923b88d-3fb4-45d3-b3db-e2b215ea7823 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:04.793958 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f923b88d-3fb4-45d3-b3db-e2b215ea7823 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:04.950097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f923b88d-3fb4-45d3-b3db-e2b215ea7823 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:04.959960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f923b88d-3fb4-45d3-b3db-e2b215ea7823 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1509 microversion: 2.1 time: 0.182409 Jun 21 08:18:04.968109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 205/406] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:04 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:05.147121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c459df41-ece4-4c29-89fb-bb53d7a639ce tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:05.148101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c459df41-ece4-4c29-89fb-bb53d7a639ce tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:05.156961 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c459df41-ece4-4c29-89fb-bb53d7a639ce tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:05.157617 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c459df41-ece4-4c29-89fb-bb53d7a639ce tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:05.158791 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c459df41-ece4-4c29-89fb-bb53d7a639ce tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:05.159583 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c459df41-ece4-4c29-89fb-bb53d7a639ce tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:05.244390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e7cfa19d-3fab-4320-aea2-53b020110504 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:05.245023 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e7cfa19d-3fab-4320-aea2-53b020110504 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:05.252421 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7cfa19d-3fab-4320-aea2-53b020110504 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:05.252936 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7cfa19d-3fab-4320-aea2-53b020110504 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:05.253726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7cfa19d-3fab-4320-aea2-53b020110504 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:05.254312 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7cfa19d-3fab-4320-aea2-53b020110504 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:05.302688 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c459df41-ece4-4c29-89fb-bb53d7a639ce tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:05.315487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c459df41-ece4-4c29-89fb-bb53d7a639ce tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1205 microversion: 2.1 time: 0.180402 Jun 21 08:18:05.320287 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 202/407] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:05 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1205 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:05.425437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e7cfa19d-3fab-4320-aea2-53b020110504 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:05.434070 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e7cfa19d-3fab-4320-aea2-53b020110504 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.194815 Jun 21 08:18:05.437097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 206/408] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:05 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:05.548123 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-d69fdef6-97ba-4aa6-b986-57e9d6384bc3 req-816582c5-3ef5-467e-86d7-af9d9783e7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6909a083-0588-4b06-916a-e9b153960ffa", "tag": "b38df0c4-4ff4-4131-becf-c141ab0b4a03"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:05.558342 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-d69fdef6-97ba-4aa6-b986-57e9d6384bc3 req-816582c5-3ef5-467e-86d7-af9d9783e7b9 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:05.558950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-d69fdef6-97ba-4aa6-b986-57e9d6384bc3 req-816582c5-3ef5-467e-86d7-af9d9783e7b9 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:05.577329 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-d69fdef6-97ba-4aa6-b986-57e9d6384bc3 req-816582c5-3ef5-467e-86d7-af9d9783e7b9 service nova] Creating event network-changed:b38df0c4-4ff4-4131-becf-c141ab0b4a03 for instance 6909a083-0588-4b06-916a-e9b153960ffa on hv-cinder-83697 Jun 21 08:18:05.583622 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-d69fdef6-97ba-4aa6-b986-57e9d6384bc3 req-816582c5-3ef5-467e-86d7-af9d9783e7b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039610 Jun 21 08:18:05.584920 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 203/409] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:05.723556 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-37f54c3b-67cf-42a5-a690-a8fb3013f729 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:05.724174 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-37f54c3b-67cf-42a5-a690-a8fb3013f729 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:05.730773 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-37f54c3b-67cf-42a5-a690-a8fb3013f729 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:05.731515 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-37f54c3b-67cf-42a5-a690-a8fb3013f729 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:05.732288 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-37f54c3b-67cf-42a5-a690-a8fb3013f729 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:05.732725 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-37f54c3b-67cf-42a5-a690-a8fb3013f729 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:05.899873 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-37f54c3b-67cf-42a5-a690-a8fb3013f729 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:05.917504 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-37f54c3b-67cf-42a5-a690-a8fb3013f729 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.197632 Jun 21 08:18:05.918208 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 207/410] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:05 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:05.979285 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a9846f2c-0a94-413c-bf7c-d013599b5b09 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:05.980607 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a9846f2c-0a94-413c-bf7c-d013599b5b09 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:05.987605 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a9846f2c-0a94-413c-bf7c-d013599b5b09 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:05.988054 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a9846f2c-0a94-413c-bf7c-d013599b5b09 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:05.989105 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a9846f2c-0a94-413c-bf7c-d013599b5b09 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:05.989546 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a9846f2c-0a94-413c-bf7c-d013599b5b09 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:06.335614 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e20e296f-309f-4024-8346-7e41665bd63b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:06.337137 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e20e296f-309f-4024-8346-7e41665bd63b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:06.345999 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e20e296f-309f-4024-8346-7e41665bd63b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:06.346979 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e20e296f-309f-4024-8346-7e41665bd63b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:06.348011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e20e296f-309f-4024-8346-7e41665bd63b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:06.348531 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e20e296f-309f-4024-8346-7e41665bd63b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:06.438860 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e20e296f-309f-4024-8346-7e41665bd63b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:06.446587 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e20e296f-309f-4024-8346-7e41665bd63b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1193 microversion: 2.1 time: 0.116642 Jun 21 08:18:06.449358 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 208/411] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:06 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1193 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:06.456022 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a9846f2c-0a94-413c-bf7c-d013599b5b09 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:06.458169 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-44a5738d-0cec-4f64-8cc2-c98fd56bb7de tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:06.459241 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-44a5738d-0cec-4f64-8cc2-c98fd56bb7de tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:06.468219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a9846f2c-0a94-413c-bf7c-d013599b5b09 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1515 microversion: 2.1 time: 0.492713 Jun 21 08:18:06.470300 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 204/412] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:05 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1515 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:06.475125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-44a5738d-0cec-4f64-8cc2-c98fd56bb7de tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:06.475863 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-44a5738d-0cec-4f64-8cc2-c98fd56bb7de tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:06.476875 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-44a5738d-0cec-4f64-8cc2-c98fd56bb7de tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:06.477577 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-44a5738d-0cec-4f64-8cc2-c98fd56bb7de tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:06.729052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-44a5738d-0cec-4f64-8cc2-c98fd56bb7de tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:06.748946 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-44a5738d-0cec-4f64-8cc2-c98fd56bb7de tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.296974 Jun 21 08:18:06.751526 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 209/413] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:06 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:06.937051 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7575c525-1bd6-49e7-8b0d-66ee48715ba3 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:06.939098 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-7575c525-1bd6-49e7-8b0d-66ee48715ba3 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:06.982124 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7575c525-1bd6-49e7-8b0d-66ee48715ba3 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:06.982696 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7575c525-1bd6-49e7-8b0d-66ee48715ba3 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:06.983169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7575c525-1bd6-49e7-8b0d-66ee48715ba3 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:06.983609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7575c525-1bd6-49e7-8b0d-66ee48715ba3 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:07.467307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-12af78e3-46de-403d-92d4-01ab73078ae1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:07.468622 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-12af78e3-46de-403d-92d4-01ab73078ae1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:07.470337 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-7575c525-1bd6-49e7-8b0d-66ee48715ba3 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:07.475047 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-12af78e3-46de-403d-92d4-01ab73078ae1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:07.475727 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-12af78e3-46de-403d-92d4-01ab73078ae1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:07.476502 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-12af78e3-46de-403d-92d4-01ab73078ae1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:07.477084 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-12af78e3-46de-403d-92d4-01ab73078ae1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:07.479334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7575c525-1bd6-49e7-8b0d-66ee48715ba3 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.546465 Jun 21 08:18:07.479909 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 205/414] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:06 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:07.667354 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-12af78e3-46de-403d-92d4-01ab73078ae1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:07.676690 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-12af78e3-46de-403d-92d4-01ab73078ae1 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.213738 Jun 21 08:18:07.685775 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 210/415] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:07 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:07.767979 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1c3edbc9-d155-4190-9fc4-1540cd4c5960 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:07.768707 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1c3edbc9-d155-4190-9fc4-1540cd4c5960 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:07.775365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1c3edbc9-d155-4190-9fc4-1540cd4c5960 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:07.775903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1c3edbc9-d155-4190-9fc4-1540cd4c5960 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:07.784151 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1c3edbc9-d155-4190-9fc4-1540cd4c5960 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:07.784636 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1c3edbc9-d155-4190-9fc4-1540cd4c5960 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:07.930231 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1c3edbc9-d155-4190-9fc4-1540cd4c5960 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:07.939319 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1c3edbc9-d155-4190-9fc4-1540cd4c5960 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.175676 Jun 21 08:18:07.939892 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 206/416] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:07 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:08.135461 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9d4538f6-be0d-42de-aabc-91bf2a64f19c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'create', calling method: .version_select at 0x7fded821f3a0>, body: {"keypair": {"name": "tempest-keypair-690890215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgZ16b7YZkGhI+6TDhinzsYMMbLqB1wXRxhd1gvQmKBZgb0wAntddQJ0N/Br5ZgYRm2ZfNUnsQa2Xx98zzFy0QwXH9x9Yc6dymw1nKL1lA0Ef+yJiXIm8lNoX9SVRs+ZA=="}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:08.149307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-9d4538f6-be0d-42de-aabc-91bf2a64f19c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Getting quotas for project 2001b029fae0472d8ef7b6fd658ad191. Resources: {'key_pairs'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:18:08.153096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-9d4538f6-be0d-42de-aabc-91bf2a64f19c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Getting quotas for user 771f36afce0a4dd8897bb22f3c330856 and project 2001b029fae0472d8ef7b6fd658ad191. Resources: {'key_pairs'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:18:08.167808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:08.177883 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9d4538f6-be0d-42de-aabc-91bf2a64f19c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046283 Jun 21 08:18:08.178481 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 211/417] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 08:18:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:08.498424 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f48624af-5a38-4f61-8fa4-44158d38eb5f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:08.499371 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f48624af-5a38-4f61-8fa4-44158d38eb5f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:08.510441 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f48624af-5a38-4f61-8fa4-44158d38eb5f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:08.511074 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f48624af-5a38-4f61-8fa4-44158d38eb5f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:08.512141 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f48624af-5a38-4f61-8fa4-44158d38eb5f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:08.512724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f48624af-5a38-4f61-8fa4-44158d38eb5f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:08.695586 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4da14eb6-f889-4820-97a8-0766561b4511 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:08.696936 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4da14eb6-f889-4820-97a8-0766561b4511 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:08.705078 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4da14eb6-f889-4820-97a8-0766561b4511 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:08.705808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4da14eb6-f889-4820-97a8-0766561b4511 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:08.707022 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4da14eb6-f889-4820-97a8-0766561b4511 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:08.707818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4da14eb6-f889-4820-97a8-0766561b4511 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:08.763276 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f48624af-5a38-4f61-8fa4-44158d38eb5f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:08.773399 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f48624af-5a38-4f61-8fa4-44158d38eb5f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.280191 Jun 21 08:18:08.776885 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 207/418] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:08 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:08.958758 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-04cb34a3-4f14-4cbd-83fa-c9884c3b2024 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:08.960222 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-04cb34a3-4f14-4cbd-83fa-c9884c3b2024 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:08.968463 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04cb34a3-4f14-4cbd-83fa-c9884c3b2024 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:08.970671 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04cb34a3-4f14-4cbd-83fa-c9884c3b2024 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:08.972628 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04cb34a3-4f14-4cbd-83fa-c9884c3b2024 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:08.973078 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-04cb34a3-4f14-4cbd-83fa-c9884c3b2024 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:09.056024 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4da14eb6-f889-4820-97a8-0766561b4511 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:09.069948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4da14eb6-f889-4820-97a8-0766561b4511 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.379537 Jun 21 08:18:09.080882 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 212/419] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:08 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:09.213537 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-04cb34a3-4f14-4cbd-83fa-c9884c3b2024 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:09.227539 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-04cb34a3-4f14-4cbd-83fa-c9884c3b2024 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.275149 Jun 21 08:18:09.228127 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 208/420] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:08 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:09.538652 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-578c7fec-ae10-4f4b-8049-231b948b2cfb req-537a1208-f812-46e7-8b71-44e066fa6298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d983b34e-0d69-4afd-9bb6-f13213be6bb1", "tag": "db75733d-f744-4c74-924b-254ed8090967"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:09.577317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-578c7fec-ae10-4f4b-8049-231b948b2cfb req-537a1208-f812-46e7-8b71-44e066fa6298 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:09.577784 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-578c7fec-ae10-4f4b-8049-231b948b2cfb req-537a1208-f812-46e7-8b71-44e066fa6298 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:09.602299 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-578c7fec-ae10-4f4b-8049-231b948b2cfb req-537a1208-f812-46e7-8b71-44e066fa6298 service nova] Creating event network-changed:db75733d-f744-4c74-924b-254ed8090967 for instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 on hv-cinder-83697 Jun 21 08:18:09.612596 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-578c7fec-ae10-4f4b-8049-231b948b2cfb req-537a1208-f812-46e7-8b71-44e066fa6298 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080040 Jun 21 08:18:09.614517 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 213/421] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:09.796289 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c3e04c30-795f-4b28-b386-49bb8070729a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:09.799247 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c3e04c30-795f-4b28-b386-49bb8070729a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:09.808316 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c3e04c30-795f-4b28-b386-49bb8070729a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:09.808977 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c3e04c30-795f-4b28-b386-49bb8070729a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:09.810064 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c3e04c30-795f-4b28-b386-49bb8070729a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:09.810739 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c3e04c30-795f-4b28-b386-49bb8070729a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:09.978270 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-216812496", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98aed940-6352-48a8-ae3d-f07b94cd1263"}], "security_groups": [{"name": "tempest-securitygroup--1991319221"}], "key_name": "tempest-keypair-690890215", "user_data": "}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:10.067488 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c3e04c30-795f-4b28-b386-49bb8070729a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:10.076042 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c3e04c30-795f-4b28-b386-49bb8070729a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.287003 Jun 21 08:18:10.085443 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 209/422] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:09 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:10.089859 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4d96a26f-7f06-4b0a-8aee-7f32f91c8763 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:10.090738 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4d96a26f-7f06-4b0a-8aee-7f32f91c8763 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:10.098650 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4d96a26f-7f06-4b0a-8aee-7f32f91c8763 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:10.099378 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4d96a26f-7f06-4b0a-8aee-7f32f91c8763 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:10.100337 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4d96a26f-7f06-4b0a-8aee-7f32f91c8763 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:10.100885 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4d96a26f-7f06-4b0a-8aee-7f32f91c8763 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:10.172389 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] validate_networks() for [('98aed940-6352-48a8-ae3d-f07b94cd1263', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:18:10.302559 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4d96a26f-7f06-4b0a-8aee-7f32f91c8763 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:10.311693 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4d96a26f-7f06-4b0a-8aee-7f32f91c8763 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.226756 Jun 21 08:18:10.312642 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 210/423] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:10 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:10.317985 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-59bfabd3-6fcf-4832-bfa4-772fa022387b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:10.318707 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-59bfabd3-6fcf-4832-bfa4-772fa022387b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:10.332745 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-59bfabd3-6fcf-4832-bfa4-772fa022387b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:10.333202 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-59bfabd3-6fcf-4832-bfa4-772fa022387b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:10.333974 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-59bfabd3-6fcf-4832-bfa4-772fa022387b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:10.334409 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-59bfabd3-6fcf-4832-bfa4-772fa022387b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:10.469983 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-59bfabd3-6fcf-4832-bfa4-772fa022387b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:10.483252 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-59bfabd3-6fcf-4832-bfa4-772fa022387b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.168958 Jun 21 08:18:10.485375 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 211/424] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:10 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:10.726502 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:18:10.727068 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:18:10.727552 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:18:10.727964 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:18:10.728388 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:18:10.741090 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:10.741536 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:10.742321 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:10.746107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:10.774295 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Getting quotas for project 2001b029fae0472d8ef7b6fd658ad191. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:18:10.779539 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Getting quotas for user 771f36afce0a4dd8897bb22f3c330856 and project 2001b029fae0472d8ef7b6fd658ad191. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:18:10.791480 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:18:10.793813 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:18:10.842590 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d0ca88d9-7867-49a0-a3e4-9a35956b0d5e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.869455 Jun 21 08:18:10.855020 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4509c289-c6c7-452e-a8e7-242c2f5eef68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:10.856434 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4509c289-c6c7-452e-a8e7-242c2f5eef68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:10.858860 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 214/425] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:18:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:18:10.986420 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4509c289-c6c7-452e-a8e7-242c2f5eef68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:10.994829 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4509c289-c6c7-452e-a8e7-242c2f5eef68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1244 microversion: 2.1 time: 0.143770 Jun 21 08:18:11.005423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 212/426] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:10 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1244 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:11.095650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d0cfc362-86d0-4c00-a9c6-412ca4bf6faa tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:11.096890 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d0cfc362-86d0-4c00-a9c6-412ca4bf6faa tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:11.104238 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0cfc362-86d0-4c00-a9c6-412ca4bf6faa tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:11.104886 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0cfc362-86d0-4c00-a9c6-412ca4bf6faa tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:11.105666 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0cfc362-86d0-4c00-a9c6-412ca4bf6faa tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:11.106212 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0cfc362-86d0-4c00-a9c6-412ca4bf6faa tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:11.123035 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:11.329574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fcf8d222-a0dd-4fad-a932-7f1f09b5c8b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:11.330167 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-fcf8d222-a0dd-4fad-a932-7f1f09b5c8b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:11.332747 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d0cfc362-86d0-4c00-a9c6-412ca4bf6faa tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:11.341057 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fcf8d222-a0dd-4fad-a932-7f1f09b5c8b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:11.341565 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fcf8d222-a0dd-4fad-a932-7f1f09b5c8b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:11.342371 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fcf8d222-a0dd-4fad-a932-7f1f09b5c8b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:11.342896 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fcf8d222-a0dd-4fad-a932-7f1f09b5c8b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:11.358849 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d0cfc362-86d0-4c00-a9c6-412ca4bf6faa tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.268137 Jun 21 08:18:11.362080 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 215/427] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:11 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:11.500903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fcf8d222-a0dd-4fad-a932-7f1f09b5c8b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:11.501104 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c37db810-b18c-48fa-8dbf-7e90864ce803 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:11.501935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c37db810-b18c-48fa-8dbf-7e90864ce803 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:11.508154 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c37db810-b18c-48fa-8dbf-7e90864ce803 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:11.508799 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c37db810-b18c-48fa-8dbf-7e90864ce803 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:11.509747 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c37db810-b18c-48fa-8dbf-7e90864ce803 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:11.510328 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c37db810-b18c-48fa-8dbf-7e90864ce803 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:11.510529 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fcf8d222-a0dd-4fad-a932-7f1f09b5c8b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.185096 Jun 21 08:18:11.520085 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 213/428] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:11 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:11.665989 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c37db810-b18c-48fa-8dbf-7e90864ce803 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:11.673908 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c37db810-b18c-48fa-8dbf-7e90864ce803 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.176997 Jun 21 08:18:11.674464 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 216/429] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:11 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:12.019483 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a336adc3-0816-43cd-9b9d-841c0be1364d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:12.020748 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a336adc3-0816-43cd-9b9d-841c0be1364d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:12.048008 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a336adc3-0816-43cd-9b9d-841c0be1364d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:12.048827 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a336adc3-0816-43cd-9b9d-841c0be1364d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:12.052173 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a336adc3-0816-43cd-9b9d-841c0be1364d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:12.053019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a336adc3-0816-43cd-9b9d-841c0be1364d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:12.173929 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a336adc3-0816-43cd-9b9d-841c0be1364d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:12.183589 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a336adc3-0816-43cd-9b9d-841c0be1364d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1304 microversion: 2.1 time: 0.170079 Jun 21 08:18:12.186778 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 214/430] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:12 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:12.244545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-5e414013-af22-402c-9a78-6cb796259283 req-bf4b7a7b-9fd9-4a7e-9d5d-b8b98364a32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32533add-63db-4d29-9be0-09f5ec2c39b3", "name": "network-vif-plugged", "status": "completed", "tag": "caad30cb-6338-4d28-a42e-d858cceaec6f"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:12.267558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-5e414013-af22-402c-9a78-6cb796259283 req-bf4b7a7b-9fd9-4a7e-9d5d-b8b98364a32d service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:12.268527 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-5e414013-af22-402c-9a78-6cb796259283 req-bf4b7a7b-9fd9-4a7e-9d5d-b8b98364a32d service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:12.284119 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-5e414013-af22-402c-9a78-6cb796259283 req-bf4b7a7b-9fd9-4a7e-9d5d-b8b98364a32d service nova] Creating event network-vif-plugged:caad30cb-6338-4d28-a42e-d858cceaec6f for instance 32533add-63db-4d29-9be0-09f5ec2c39b3 on hv-cinder-83697 Jun 21 08:18:12.290529 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-5e414013-af22-402c-9a78-6cb796259283 req-bf4b7a7b-9fd9-4a7e-9d5d-b8b98364a32d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050257 Jun 21 08:18:12.291812 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 217/431] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:18:12.381707 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6eba9836-80a0-4ab8-aac1-5e923f22ad9e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:12.382349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6eba9836-80a0-4ab8-aac1-5e923f22ad9e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:12.388754 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6eba9836-80a0-4ab8-aac1-5e923f22ad9e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:12.389202 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6eba9836-80a0-4ab8-aac1-5e923f22ad9e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:12.390020 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6eba9836-80a0-4ab8-aac1-5e923f22ad9e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:12.390458 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6eba9836-80a0-4ab8-aac1-5e923f22ad9e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:12.528126 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-47972d58-87bb-49d8-88c7-a35cc8c1053f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:12.528967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-47972d58-87bb-49d8-88c7-a35cc8c1053f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:12.538262 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-47972d58-87bb-49d8-88c7-a35cc8c1053f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:12.540232 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-47972d58-87bb-49d8-88c7-a35cc8c1053f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:12.541978 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-47972d58-87bb-49d8-88c7-a35cc8c1053f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:12.545572 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-47972d58-87bb-49d8-88c7-a35cc8c1053f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:12.688429 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-47972d58-87bb-49d8-88c7-a35cc8c1053f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:12.696080 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-47972d58-87bb-49d8-88c7-a35cc8c1053f tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.172332 Jun 21 08:18:12.697066 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 218/432] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:12 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:12.701932 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a098507a-85bf-4404-a098-9fabdbde9d96 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:12.702535 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a098507a-85bf-4404-a098-9fabdbde9d96 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:12.717041 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a098507a-85bf-4404-a098-9fabdbde9d96 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:12.718222 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a098507a-85bf-4404-a098-9fabdbde9d96 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:12.719651 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a098507a-85bf-4404-a098-9fabdbde9d96 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:12.721725 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a098507a-85bf-4404-a098-9fabdbde9d96 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:12.827637 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6eba9836-80a0-4ab8-aac1-5e923f22ad9e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:12.840048 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6eba9836-80a0-4ab8-aac1-5e923f22ad9e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.465245 Jun 21 08:18:12.841627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 215/433] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:12 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:12.873138 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a098507a-85bf-4404-a098-9fabdbde9d96 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:12.882186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a098507a-85bf-4404-a098-9fabdbde9d96 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.183889 Jun 21 08:18:12.883128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 219/434] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:12 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:13.205559 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c1913573-70f1-4b20-9004-1db1092c2da6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:13.207524 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c1913573-70f1-4b20-9004-1db1092c2da6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:13.220132 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c1913573-70f1-4b20-9004-1db1092c2da6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:13.223213 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c1913573-70f1-4b20-9004-1db1092c2da6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:13.224791 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c1913573-70f1-4b20-9004-1db1092c2da6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:13.225855 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c1913573-70f1-4b20-9004-1db1092c2da6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:13.430118 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c1913573-70f1-4b20-9004-1db1092c2da6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:13.438810 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c1913573-70f1-4b20-9004-1db1092c2da6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.238293 Jun 21 08:18:13.439354 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 216/435] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:13 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:13.714243 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fcbefed5-3fa4-4a50-bf2a-b44b003d022c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:13.714900 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fcbefed5-3fa4-4a50-bf2a-b44b003d022c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:13.722571 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fcbefed5-3fa4-4a50-bf2a-b44b003d022c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:13.723218 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fcbefed5-3fa4-4a50-bf2a-b44b003d022c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:13.724133 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fcbefed5-3fa4-4a50-bf2a-b44b003d022c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:13.724628 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fcbefed5-3fa4-4a50-bf2a-b44b003d022c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:13.858942 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d8a918e4-09f2-4ce9-82e9-e1e349942edd tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:13.860065 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d8a918e4-09f2-4ce9-82e9-e1e349942edd tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:13.867720 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d8a918e4-09f2-4ce9-82e9-e1e349942edd tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:13.868172 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d8a918e4-09f2-4ce9-82e9-e1e349942edd tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:13.869034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d8a918e4-09f2-4ce9-82e9-e1e349942edd tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:13.869545 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d8a918e4-09f2-4ce9-82e9-e1e349942edd tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:13.877211 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fcbefed5-3fa4-4a50-bf2a-b44b003d022c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:13.902391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fcbefed5-3fa4-4a50-bf2a-b44b003d022c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.186628 Jun 21 08:18:13.903046 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 220/436] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:13 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:13.912154 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8677d9db-e061-4b80-9421-e2aa1f092644 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:13.912642 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8677d9db-e061-4b80-9421-e2aa1f092644 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:13.919105 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8677d9db-e061-4b80-9421-e2aa1f092644 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:13.919780 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8677d9db-e061-4b80-9421-e2aa1f092644 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:13.920636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8677d9db-e061-4b80-9421-e2aa1f092644 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:13.921082 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8677d9db-e061-4b80-9421-e2aa1f092644 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:14.060025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8677d9db-e061-4b80-9421-e2aa1f092644 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:14.068514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8677d9db-e061-4b80-9421-e2aa1f092644 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1724 microversion: 2.1 time: 0.164475 Jun 21 08:18:14.069074 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 221/437] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:13 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:14.127943 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d8a918e4-09f2-4ce9-82e9-e1e349942edd tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:14.139214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d8a918e4-09f2-4ce9-82e9-e1e349942edd tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1357 microversion: 2.1 time: 0.285440 Jun 21 08:18:14.140664 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 217/438] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:13 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1357 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:14.457834 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5d34e0f5-08fa-4027-9e0d-b4ed3bf41c5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:14.458458 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5d34e0f5-08fa-4027-9e0d-b4ed3bf41c5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:14.465533 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5d34e0f5-08fa-4027-9e0d-b4ed3bf41c5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:14.465981 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5d34e0f5-08fa-4027-9e0d-b4ed3bf41c5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:14.467033 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5d34e0f5-08fa-4027-9e0d-b4ed3bf41c5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:14.467761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5d34e0f5-08fa-4027-9e0d-b4ed3bf41c5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:14.525176 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-7a49d5cb-8417-4840-bf45-8499f542e75a req-aba6087a-21e2-4429-8574-bfd4d4a514f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9636db4b-57b1-4e11-832b-584baecd8ed2", "tag": "2cf35fad-280a-42ee-a53d-2d69eb288575"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:14.538680 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-7a49d5cb-8417-4840-bf45-8499f542e75a req-aba6087a-21e2-4429-8574-bfd4d4a514f5 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:14.539356 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-7a49d5cb-8417-4840-bf45-8499f542e75a req-aba6087a-21e2-4429-8574-bfd4d4a514f5 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:14.553442 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-7a49d5cb-8417-4840-bf45-8499f542e75a req-aba6087a-21e2-4429-8574-bfd4d4a514f5 service nova] Creating event network-changed:2cf35fad-280a-42ee-a53d-2d69eb288575 for instance 9636db4b-57b1-4e11-832b-584baecd8ed2 on hv-cinder-83697 Jun 21 08:18:14.558931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-7a49d5cb-8417-4840-bf45-8499f542e75a req-aba6087a-21e2-4429-8574-bfd4d4a514f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037214 Jun 21 08:18:14.560034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 218/439] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:18:14.643726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5d34e0f5-08fa-4027-9e0d-b4ed3bf41c5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:14.660925 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5d34e0f5-08fa-4027-9e0d-b4ed3bf41c5d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.207880 Jun 21 08:18:14.661658 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 222/440] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:14 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:14.919681 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c539a7b7-b5fb-4476-a3c7-e4b49562d87b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:14.920461 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c539a7b7-b5fb-4476-a3c7-e4b49562d87b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:14.927756 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c539a7b7-b5fb-4476-a3c7-e4b49562d87b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:14.928255 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c539a7b7-b5fb-4476-a3c7-e4b49562d87b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:14.929223 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c539a7b7-b5fb-4476-a3c7-e4b49562d87b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:14.929659 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c539a7b7-b5fb-4476-a3c7-e4b49562d87b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.085377 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1da13e00-308c-4012-99be-b5b40b371aae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:15.085996 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1da13e00-308c-4012-99be-b5b40b371aae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:15.091897 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1da13e00-308c-4012-99be-b5b40b371aae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.092339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1da13e00-308c-4012-99be-b5b40b371aae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.093089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1da13e00-308c-4012-99be-b5b40b371aae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.093551 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1da13e00-308c-4012-99be-b5b40b371aae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.111783 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c539a7b7-b5fb-4476-a3c7-e4b49562d87b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:15.119982 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c539a7b7-b5fb-4476-a3c7-e4b49562d87b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.204448 Jun 21 08:18:15.120562 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 219/441] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:14 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:15.158708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3b7b873d-ac1d-4b28-99a7-8b5e32cf6ca7 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:15.159336 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3b7b873d-ac1d-4b28-99a7-8b5e32cf6ca7 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:15.166334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3b7b873d-ac1d-4b28-99a7-8b5e32cf6ca7 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.167039 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3b7b873d-ac1d-4b28-99a7-8b5e32cf6ca7 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.168015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3b7b873d-ac1d-4b28-99a7-8b5e32cf6ca7 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.168564 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3b7b873d-ac1d-4b28-99a7-8b5e32cf6ca7 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.187200 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=100 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:15.228689 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1da13e00-308c-4012-99be-b5b40b371aae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:15.237372 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1da13e00-308c-4012-99be-b5b40b371aae tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1701 microversion: 2.1 time: 0.155881 Jun 21 08:18:15.237936 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 223/442] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:15 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:15.253761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-700007b2-a1f6-4402-b437-b4e1c6ef3be3 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:15.259606 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-700007b2-a1f6-4402-b437-b4e1c6ef3be3 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.260051 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-700007b2-a1f6-4402-b437-b4e1c6ef3be3 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.321541 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-700007b2-a1f6-4402-b437-b4e1c6ef3be3 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Going to try to start instance {{(pid=117547) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 08:18:15.369359 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-700007b2-a1f6-4402-b437-b4e1c6ef3be3 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/action" status: 202 len: 0 microversion: 2.1 time: 0.119074 Jun 21 08:18:15.373151 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 224/443] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:18:15 2022] POST /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 08:18:15.382498 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3b7b873d-ac1d-4b28-99a7-8b5e32cf6ca7 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:15.388940 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-be54adc6-0dad-4d50-a118-f16e2c655398 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:15.389656 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-be54adc6-0dad-4d50-a118-f16e2c655398 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:15.394838 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3b7b873d-ac1d-4b28-99a7-8b5e32cf6ca7 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1547 microversion: 2.1 time: 0.241098 Jun 21 08:18:15.396528 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 220/444] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:15 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1547 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:15.409763 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-be54adc6-0dad-4d50-a118-f16e2c655398 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.410212 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-be54adc6-0dad-4d50-a118-f16e2c655398 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.411017 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-be54adc6-0dad-4d50-a118-f16e2c655398 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.411597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-be54adc6-0dad-4d50-a118-f16e2c655398 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.432019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7d4ce0f5-1723-43b9-8f0b-f3cbaab0baf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:15.432639 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-7d4ce0f5-1723-43b9-8f0b-f3cbaab0baf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:15.439833 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7d4ce0f5-1723-43b9-8f0b-f3cbaab0baf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.440281 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7d4ce0f5-1723-43b9-8f0b-f3cbaab0baf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.441048 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7d4ce0f5-1723-43b9-8f0b-f3cbaab0baf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.441476 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7d4ce0f5-1723-43b9-8f0b-f3cbaab0baf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.602471 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-be54adc6-0dad-4d50-a118-f16e2c655398 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:15.615600 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-be54adc6-0dad-4d50-a118-f16e2c655398 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.239813 Jun 21 08:18:15.616385 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 225/445] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:15 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:15.678578 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-856f53d1-6b04-4070-a12c-0d0f5f867a68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:15.679359 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-856f53d1-6b04-4070-a12c-0d0f5f867a68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:15.683560 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-7d4ce0f5-1723-43b9-8f0b-f3cbaab0baf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:15.685977 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-856f53d1-6b04-4070-a12c-0d0f5f867a68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.686702 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-856f53d1-6b04-4070-a12c-0d0f5f867a68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.687751 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-856f53d1-6b04-4070-a12c-0d0f5f867a68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.688847 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-856f53d1-6b04-4070-a12c-0d0f5f867a68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.693809 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7d4ce0f5-1723-43b9-8f0b-f3cbaab0baf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1547 microversion: 2.1 time: 0.274314 Jun 21 08:18:15.694403 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 221/446] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:15 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1547 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:15.710237 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8cef02ae-7a7f-42f7-a0b7-6bedb0335987 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:15.713875 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8cef02ae-7a7f-42f7-a0b7-6bedb0335987 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:15.714946 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8cef02ae-7a7f-42f7-a0b7-6bedb0335987 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Searching by: {'deleted': False, 'project_id': '054a41c637b243f180a79969432bb3f8'} {{(pid=117548) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 21 08:18:15.724296 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8cef02ae-7a7f-42f7-a0b7-6bedb0335987 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.724814 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8cef02ae-7a7f-42f7-a0b7-6bedb0335987 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.725790 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8cef02ae-7a7f-42f7-a0b7-6bedb0335987 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.726567 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8cef02ae-7a7f-42f7-a0b7-6bedb0335987 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.830156 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.multi_cell_list [None req-8cef02ae-7a7f-42f7-a0b7-6bedb0335987 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 21 08:18:15.853172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-856f53d1-6b04-4070-a12c-0d0f5f867a68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:15.862329 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-856f53d1-6b04-4070-a12c-0d0f5f867a68 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.188265 Jun 21 08:18:15.864736 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 226/447] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:15 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:15.940486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8cef02ae-7a7f-42f7-a0b7-6bedb0335987 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.233972 Jun 21 08:18:15.941407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 222/448] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Jun 21 08:18:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:18:15.951194 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f7c74b48-ddf5-4368-b0c5-188653b9e6ba tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:15.951809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f7c74b48-ddf5-4368-b0c5-188653b9e6ba tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:15.958144 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f7c74b48-ddf5-4368-b0c5-188653b9e6ba tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.958584 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f7c74b48-ddf5-4368-b0c5-188653b9e6ba tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:15.959419 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f7c74b48-ddf5-4368-b0c5-188653b9e6ba tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:15.959845 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f7c74b48-ddf5-4368-b0c5-188653b9e6ba tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:16.090769 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f7c74b48-ddf5-4368-b0c5-188653b9e6ba tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:16.100766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f7c74b48-ddf5-4368-b0c5-188653b9e6ba tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1547 microversion: 2.1 time: 0.153186 Jun 21 08:18:16.101926 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 227/449] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:15 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:16.138469 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c01d7d40-666f-4df2-ab37-03233159ba48 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:16.139221 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c01d7d40-666f-4df2-ab37-03233159ba48 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:16.146133 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c01d7d40-666f-4df2-ab37-03233159ba48 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:16.146679 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c01d7d40-666f-4df2-ab37-03233159ba48 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:16.147708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c01d7d40-666f-4df2-ab37-03233159ba48 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:16.148216 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c01d7d40-666f-4df2-ab37-03233159ba48 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:16.308999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c01d7d40-666f-4df2-ab37-03233159ba48 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:16.319545 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c01d7d40-666f-4df2-ab37-03233159ba48 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.185113 Jun 21 08:18:16.320397 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 223/450] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:16 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:16.633080 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-064a8317-93ee-4e0f-ada8-d8a576827184 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:16.633697 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-064a8317-93ee-4e0f-ada8-d8a576827184 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:16.639879 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-064a8317-93ee-4e0f-ada8-d8a576827184 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:16.640335 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-064a8317-93ee-4e0f-ada8-d8a576827184 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:16.641145 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-064a8317-93ee-4e0f-ada8-d8a576827184 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:16.641591 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-064a8317-93ee-4e0f-ada8-d8a576827184 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:16.787076 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-064a8317-93ee-4e0f-ada8-d8a576827184 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:16.795618 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-064a8317-93ee-4e0f-ada8-d8a576827184 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.166255 Jun 21 08:18:16.796510 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 228/451] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:16 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:16.880396 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-285007b9-0d78-49d2-bd36-0c22fb7a7d3d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:16.881019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-285007b9-0d78-49d2-bd36-0c22fb7a7d3d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:16.888677 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-285007b9-0d78-49d2-bd36-0c22fb7a7d3d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:16.889138 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-285007b9-0d78-49d2-bd36-0c22fb7a7d3d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:16.889912 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-285007b9-0d78-49d2-bd36-0c22fb7a7d3d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:16.890342 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-285007b9-0d78-49d2-bd36-0c22fb7a7d3d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:17.037379 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-285007b9-0d78-49d2-bd36-0c22fb7a7d3d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:17.050964 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-285007b9-0d78-49d2-bd36-0c22fb7a7d3d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.176449 Jun 21 08:18:17.051658 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 224/452] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:16 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:17.336220 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ee45bcf4-cdeb-4625-988a-dcdcc42eb4ef tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:17.336825 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ee45bcf4-cdeb-4625-988a-dcdcc42eb4ef tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:17.342748 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee45bcf4-cdeb-4625-988a-dcdcc42eb4ef tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:17.343194 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee45bcf4-cdeb-4625-988a-dcdcc42eb4ef tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:17.343944 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee45bcf4-cdeb-4625-988a-dcdcc42eb4ef tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:17.344371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee45bcf4-cdeb-4625-988a-dcdcc42eb4ef tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:17.474435 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ee45bcf4-cdeb-4625-988a-dcdcc42eb4ef tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:17.482223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ee45bcf4-cdeb-4625-988a-dcdcc42eb4ef tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.150016 Jun 21 08:18:17.482970 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 229/453] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:17 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:17.670136 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c5a56a0a-c45c-4e5f-8caa-5b8f930f9155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "563a0226-e01c-46d9-b1d7-24fb8632e657"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:17.671288 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c5a56a0a-c45c-4e5f-8caa-5b8f930f9155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:17.677762 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5a56a0a-c45c-4e5f-8caa-5b8f930f9155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:17.678208 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5a56a0a-c45c-4e5f-8caa-5b8f930f9155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:17.678996 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5a56a0a-c45c-4e5f-8caa-5b8f930f9155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:17.679426 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5a56a0a-c45c-4e5f-8caa-5b8f930f9155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:17.812503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-beedee1b-8600-4b62-aa2f-384754c329a4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:17.813107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-beedee1b-8600-4b62-aa2f-384754c329a4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:17.819588 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-beedee1b-8600-4b62-aa2f-384754c329a4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:17.820033 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-beedee1b-8600-4b62-aa2f-384754c329a4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:17.820784 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-beedee1b-8600-4b62-aa2f-384754c329a4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:17.821215 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-beedee1b-8600-4b62-aa2f-384754c329a4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:17.948780 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-beedee1b-8600-4b62-aa2f-384754c329a4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:17.957679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-beedee1b-8600-4b62-aa2f-384754c329a4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.148794 Jun 21 08:18:17.958186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 230/454] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:17 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:18.068759 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-2036bf93-776a-426c-9763-00b57db58ea6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:18.069464 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-2036bf93-776a-426c-9763-00b57db58ea6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:18.076677 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2036bf93-776a-426c-9763-00b57db58ea6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:18.077162 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2036bf93-776a-426c-9763-00b57db58ea6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:18.077895 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2036bf93-776a-426c-9763-00b57db58ea6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:18.078347 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2036bf93-776a-426c-9763-00b57db58ea6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:18.098945 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:18.217484 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2036bf93-776a-426c-9763-00b57db58ea6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:18.225431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-2036bf93-776a-426c-9763-00b57db58ea6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.161500 Jun 21 08:18:18.225992 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 231/455] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:18 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:18.501637 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4d185881-ad9b-4f42-9a63-e9e078966098 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:18.502254 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4d185881-ad9b-4f42-9a63-e9e078966098 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:18.509386 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4d185881-ad9b-4f42-9a63-e9e078966098 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:18.509832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4d185881-ad9b-4f42-9a63-e9e078966098 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:18.510599 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4d185881-ad9b-4f42-9a63-e9e078966098 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:18.511055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4d185881-ad9b-4f42-9a63-e9e078966098 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:18.673493 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4d185881-ad9b-4f42-9a63-e9e078966098 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:18.682070 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4d185881-ad9b-4f42-9a63-e9e078966098 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.184686 Jun 21 08:18:18.682661 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 232/456] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:18 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:18.975168 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8b648fb8-0b8f-413a-9a15-ffde488bb266 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:18.975897 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8b648fb8-0b8f-413a-9a15-ffde488bb266 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:18.982854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8b648fb8-0b8f-413a-9a15-ffde488bb266 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:18.983309 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8b648fb8-0b8f-413a-9a15-ffde488bb266 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:18.984110 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8b648fb8-0b8f-413a-9a15-ffde488bb266 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:18.984551 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8b648fb8-0b8f-413a-9a15-ffde488bb266 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:19.168999 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8b648fb8-0b8f-413a-9a15-ffde488bb266 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:19.181541 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8b648fb8-0b8f-413a-9a15-ffde488bb266 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.211034 Jun 21 08:18:19.182370 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 233/457] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:18 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:19.242908 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-705202bc-accd-4222-9d8c-51344fa95564 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:19.243588 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-705202bc-accd-4222-9d8c-51344fa95564 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:19.249792 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-705202bc-accd-4222-9d8c-51344fa95564 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:19.250489 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-705202bc-accd-4222-9d8c-51344fa95564 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:19.251307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-705202bc-accd-4222-9d8c-51344fa95564 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:19.251738 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-705202bc-accd-4222-9d8c-51344fa95564 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:19.556661 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-705202bc-accd-4222-9d8c-51344fa95564 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:19.564130 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-705202bc-accd-4222-9d8c-51344fa95564 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.325138 Jun 21 08:18:19.564718 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 234/458] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:19 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:19.699351 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dc375591-d4cf-4e21-9afa-dcd0e85ebcdd tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:19.700089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-dc375591-d4cf-4e21-9afa-dcd0e85ebcdd tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:19.707100 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dc375591-d4cf-4e21-9afa-dcd0e85ebcdd tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:19.707624 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dc375591-d4cf-4e21-9afa-dcd0e85ebcdd tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:19.708473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dc375591-d4cf-4e21-9afa-dcd0e85ebcdd tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:19.708902 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dc375591-d4cf-4e21-9afa-dcd0e85ebcdd tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:19.852424 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-dc375591-d4cf-4e21-9afa-dcd0e85ebcdd tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:19.860592 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-dc375591-d4cf-4e21-9afa-dcd0e85ebcdd tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.165009 Jun 21 08:18:19.861302 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 235/459] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:19 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:20.200864 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-70dc06b5-7c85-4099-9bc9-8d97ac59997d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:20.201475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-70dc06b5-7c85-4099-9bc9-8d97ac59997d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:20.207894 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-70dc06b5-7c85-4099-9bc9-8d97ac59997d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:20.208341 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-70dc06b5-7c85-4099-9bc9-8d97ac59997d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:20.209099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-70dc06b5-7c85-4099-9bc9-8d97ac59997d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:20.209534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-70dc06b5-7c85-4099-9bc9-8d97ac59997d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:20.337850 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-70dc06b5-7c85-4099-9bc9-8d97ac59997d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:20.345699 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-70dc06b5-7c85-4099-9bc9-8d97ac59997d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.148604 Jun 21 08:18:20.346258 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 236/460] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:20 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:20.581466 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-471f2464-3f22-4e6c-8deb-55992770a74a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:20.581994 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-471f2464-3f22-4e6c-8deb-55992770a74a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:20.587869 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-471f2464-3f22-4e6c-8deb-55992770a74a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:20.588322 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-471f2464-3f22-4e6c-8deb-55992770a74a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:20.589084 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-471f2464-3f22-4e6c-8deb-55992770a74a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:20.589525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-471f2464-3f22-4e6c-8deb-55992770a74a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:20.718338 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-471f2464-3f22-4e6c-8deb-55992770a74a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:20.726271 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-471f2464-3f22-4e6c-8deb-55992770a74a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.149127 Jun 21 08:18:20.726866 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 237/461] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:20 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:20.878367 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8994c96c-71a7-4f06-bf71-4e91948c2c68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:20.878672 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8994c96c-71a7-4f06-bf71-4e91948c2c68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:20.880512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:20.881232 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=10 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:20.887881 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8994c96c-71a7-4f06-bf71-4e91948c2c68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:20.888331 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8994c96c-71a7-4f06-bf71-4e91948c2c68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:20.889094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8994c96c-71a7-4f06-bf71-4e91948c2c68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:20.889535 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8994c96c-71a7-4f06-bf71-4e91948c2c68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:20.991771 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:21.020422 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8994c96c-71a7-4f06-bf71-4e91948c2c68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:21.027790 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8994c96c-71a7-4f06-bf71-4e91948c2c68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.154026 Jun 21 08:18:21.028343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 238/462] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:20 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:21.363182 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-db8ae697-10da-4979-ade6-deda93a88810 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:21.363796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-db8ae697-10da-4979-ade6-deda93a88810 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:21.371168 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db8ae697-10da-4979-ade6-deda93a88810 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:21.371616 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db8ae697-10da-4979-ade6-deda93a88810 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:21.372378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db8ae697-10da-4979-ade6-deda93a88810 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:21.372818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db8ae697-10da-4979-ade6-deda93a88810 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:21.498445 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-db8ae697-10da-4979-ade6-deda93a88810 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:21.507119 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-db8ae697-10da-4979-ade6-deda93a88810 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.147894 Jun 21 08:18:21.507688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 239/463] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:21 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:21.743250 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6e5fbe36-0e18-4e87-b7f5-906c3db8b89f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:21.743885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6e5fbe36-0e18-4e87-b7f5-906c3db8b89f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:21.750768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e5fbe36-0e18-4e87-b7f5-906c3db8b89f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:21.751215 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e5fbe36-0e18-4e87-b7f5-906c3db8b89f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:21.751980 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e5fbe36-0e18-4e87-b7f5-906c3db8b89f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:21.752408 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e5fbe36-0e18-4e87-b7f5-906c3db8b89f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:21.886719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-6e5fbe36-0e18-4e87-b7f5-906c3db8b89f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:21.895015 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6e5fbe36-0e18-4e87-b7f5-906c3db8b89f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.155617 Jun 21 08:18:21.895933 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 240/464] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:21 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:22.044625 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-436a939c-6b11-4a0f-a1a7-8f25a6a9dac9 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:22.045187 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-436a939c-6b11-4a0f-a1a7-8f25a6a9dac9 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:22.051276 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-436a939c-6b11-4a0f-a1a7-8f25a6a9dac9 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:22.051718 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-436a939c-6b11-4a0f-a1a7-8f25a6a9dac9 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:22.052469 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-436a939c-6b11-4a0f-a1a7-8f25a6a9dac9 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:22.052913 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-436a939c-6b11-4a0f-a1a7-8f25a6a9dac9 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:22.188760 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-436a939c-6b11-4a0f-a1a7-8f25a6a9dac9 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:22.196925 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-436a939c-6b11-4a0f-a1a7-8f25a6a9dac9 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.156133 Jun 21 08:18:22.197798 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 241/465] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:22 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:22.524144 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6e993268-2877-4add-ba23-26d699b8fbd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:22.524766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6e993268-2877-4add-ba23-26d699b8fbd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:22.531719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e993268-2877-4add-ba23-26d699b8fbd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:22.532496 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e993268-2877-4add-ba23-26d699b8fbd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:22.534369 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e993268-2877-4add-ba23-26d699b8fbd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:22.535186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e993268-2877-4add-ba23-26d699b8fbd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:22.679542 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-6e993268-2877-4add-ba23-26d699b8fbd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:22.687399 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6e993268-2877-4add-ba23-26d699b8fbd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.167242 Jun 21 08:18:22.687958 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 242/466] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:22 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:22.913243 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fd874a5b-8a90-4331-989f-2634da42a3a5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:22.913861 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fd874a5b-8a90-4331-989f-2634da42a3a5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:22.920716 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fd874a5b-8a90-4331-989f-2634da42a3a5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:22.921168 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fd874a5b-8a90-4331-989f-2634da42a3a5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:22.921961 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fd874a5b-8a90-4331-989f-2634da42a3a5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:22.922399 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fd874a5b-8a90-4331-989f-2634da42a3a5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:23.050160 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fd874a5b-8a90-4331-989f-2634da42a3a5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:23.057498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fd874a5b-8a90-4331-989f-2634da42a3a5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.148169 Jun 21 08:18:23.058056 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 243/467] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:22 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:23.213136 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d969aaab-39f8-4c4b-bf1d-39a9b49cf18c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:23.213822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d969aaab-39f8-4c4b-bf1d-39a9b49cf18c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:23.220023 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d969aaab-39f8-4c4b-bf1d-39a9b49cf18c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:23.220562 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d969aaab-39f8-4c4b-bf1d-39a9b49cf18c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:23.222338 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d969aaab-39f8-4c4b-bf1d-39a9b49cf18c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:23.222848 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d969aaab-39f8-4c4b-bf1d-39a9b49cf18c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:23.351329 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d969aaab-39f8-4c4b-bf1d-39a9b49cf18c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:23.358793 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d969aaab-39f8-4c4b-bf1d-39a9b49cf18c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.149684 Jun 21 08:18:23.359362 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 244/468] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:23 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:23.704771 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c8ad49fa-a2d6-48da-8d8e-d702046d0d45 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:23.705832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c8ad49fa-a2d6-48da-8d8e-d702046d0d45 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:23.711804 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c8ad49fa-a2d6-48da-8d8e-d702046d0d45 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:23.712252 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c8ad49fa-a2d6-48da-8d8e-d702046d0d45 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:23.713523 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c8ad49fa-a2d6-48da-8d8e-d702046d0d45 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:23.713640 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c8ad49fa-a2d6-48da-8d8e-d702046d0d45 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:23.845664 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c8ad49fa-a2d6-48da-8d8e-d702046d0d45 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:23.853745 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c8ad49fa-a2d6-48da-8d8e-d702046d0d45 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.153344 Jun 21 08:18:23.854293 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 245/469] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:23 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:24.073429 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ef5a592a-a54f-4723-ae48-9748718d2007 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:24.074033 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ef5a592a-a54f-4723-ae48-9748718d2007 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:24.079972 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef5a592a-a54f-4723-ae48-9748718d2007 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:24.080414 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef5a592a-a54f-4723-ae48-9748718d2007 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:24.081205 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef5a592a-a54f-4723-ae48-9748718d2007 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:24.081631 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef5a592a-a54f-4723-ae48-9748718d2007 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:24.207731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ef5a592a-a54f-4723-ae48-9748718d2007 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:24.215137 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ef5a592a-a54f-4723-ae48-9748718d2007 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.145506 Jun 21 08:18:24.215694 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 246/470] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:24 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:24.376826 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-04342a3f-cdfa-4dbe-9923-833fc9faa121 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:24.377462 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-04342a3f-cdfa-4dbe-9923-833fc9faa121 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:24.383711 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04342a3f-cdfa-4dbe-9923-833fc9faa121 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:24.384148 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04342a3f-cdfa-4dbe-9923-833fc9faa121 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:24.384893 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04342a3f-cdfa-4dbe-9923-833fc9faa121 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:24.385322 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04342a3f-cdfa-4dbe-9923-833fc9faa121 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:24.519898 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-04342a3f-cdfa-4dbe-9923-833fc9faa121 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:24.527357 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-04342a3f-cdfa-4dbe-9923-833fc9faa121 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.154653 Jun 21 08:18:24.527921 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 247/471] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:24 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:24.871376 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-377b0780-9c12-497a-b093-be95d5f1ebe5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:24.871910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-377b0780-9c12-497a-b093-be95d5f1ebe5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:24.878166 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-377b0780-9c12-497a-b093-be95d5f1ebe5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:24.878611 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-377b0780-9c12-497a-b093-be95d5f1ebe5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:24.879979 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-377b0780-9c12-497a-b093-be95d5f1ebe5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:24.880421 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-377b0780-9c12-497a-b093-be95d5f1ebe5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:24.884288 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:25.007192 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-377b0780-9c12-497a-b093-be95d5f1ebe5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:25.014995 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-377b0780-9c12-497a-b093-be95d5f1ebe5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.147606 Jun 21 08:18:25.015553 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 248/472] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:24 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:25.232327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8bf3041a-f57c-44a6-91f5-a83da70b33a4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:25.232963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8bf3041a-f57c-44a6-91f5-a83da70b33a4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:25.239504 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8bf3041a-f57c-44a6-91f5-a83da70b33a4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:25.239947 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8bf3041a-f57c-44a6-91f5-a83da70b33a4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:25.240701 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8bf3041a-f57c-44a6-91f5-a83da70b33a4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:25.241257 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8bf3041a-f57c-44a6-91f5-a83da70b33a4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:25.370138 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8bf3041a-f57c-44a6-91f5-a83da70b33a4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:25.377836 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8bf3041a-f57c-44a6-91f5-a83da70b33a4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.149324 Jun 21 08:18:25.378427 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 249/473] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:25 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:25.544579 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ae7be833-1132-4045-832f-a8f795043716 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:25.545153 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ae7be833-1132-4045-832f-a8f795043716 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:25.552100 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae7be833-1132-4045-832f-a8f795043716 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:25.552544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae7be833-1132-4045-832f-a8f795043716 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:25.553301 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae7be833-1132-4045-832f-a8f795043716 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:25.553732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ae7be833-1132-4045-832f-a8f795043716 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:25.682523 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ae7be833-1132-4045-832f-a8f795043716 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:25.690156 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ae7be833-1132-4045-832f-a8f795043716 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.149512 Jun 21 08:18:25.690731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 250/474] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:25 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:25.760280 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:26.032796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1a1adf1d-b7cf-432d-a521-20e1e02c25d8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:26.033408 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1a1adf1d-b7cf-432d-a521-20e1e02c25d8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:26.040125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1a1adf1d-b7cf-432d-a521-20e1e02c25d8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:26.040576 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1a1adf1d-b7cf-432d-a521-20e1e02c25d8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:26.041337 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1a1adf1d-b7cf-432d-a521-20e1e02c25d8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:26.041775 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1a1adf1d-b7cf-432d-a521-20e1e02c25d8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:26.167219 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1a1adf1d-b7cf-432d-a521-20e1e02c25d8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:26.175062 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1a1adf1d-b7cf-432d-a521-20e1e02c25d8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.146156 Jun 21 08:18:26.175649 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 251/475] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:26 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:26.395553 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9d96819f-3836-4b6b-a5a2-ac24fa083b34 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:26.396212 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9d96819f-3836-4b6b-a5a2-ac24fa083b34 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:26.402195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9d96819f-3836-4b6b-a5a2-ac24fa083b34 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:26.402665 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9d96819f-3836-4b6b-a5a2-ac24fa083b34 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:26.403425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9d96819f-3836-4b6b-a5a2-ac24fa083b34 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:26.403861 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9d96819f-3836-4b6b-a5a2-ac24fa083b34 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:26.535524 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9d96819f-3836-4b6b-a5a2-ac24fa083b34 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:26.542978 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9d96819f-3836-4b6b-a5a2-ac24fa083b34 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.151783 Jun 21 08:18:26.543574 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 252/476] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:26 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:26.706658 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-01251d29-01d6-49cb-9e45-8d4a45a6470d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:26.707770 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-01251d29-01d6-49cb-9e45-8d4a45a6470d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:26.709615 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:26.715379 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01251d29-01d6-49cb-9e45-8d4a45a6470d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:26.715824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01251d29-01d6-49cb-9e45-8d4a45a6470d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:26.716579 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01251d29-01d6-49cb-9e45-8d4a45a6470d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:26.717011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01251d29-01d6-49cb-9e45-8d4a45a6470d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:26.854409 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-01251d29-01d6-49cb-9e45-8d4a45a6470d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:26.862488 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-01251d29-01d6-49cb-9e45-8d4a45a6470d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.159373 Jun 21 08:18:26.863893 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 253/477] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:26 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:27.192035 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-bfa0764a-685c-48e9-bec5-0a6b7a25e372 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:27.192574 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-bfa0764a-685c-48e9-bec5-0a6b7a25e372 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:27.198573 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bfa0764a-685c-48e9-bec5-0a6b7a25e372 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:27.199055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bfa0764a-685c-48e9-bec5-0a6b7a25e372 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:27.199821 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bfa0764a-685c-48e9-bec5-0a6b7a25e372 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:27.200260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bfa0764a-685c-48e9-bec5-0a6b7a25e372 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:27.329996 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-bfa0764a-685c-48e9-bec5-0a6b7a25e372 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:27.338060 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-bfa0764a-685c-48e9-bec5-0a6b7a25e372 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.150047 Jun 21 08:18:27.338645 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 254/478] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:27 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:27.560410 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4336d55b-da9e-4573-a2e0-a128bfeef342 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:27.561032 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4336d55b-da9e-4573-a2e0-a128bfeef342 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:27.567628 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4336d55b-da9e-4573-a2e0-a128bfeef342 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:27.568083 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4336d55b-da9e-4573-a2e0-a128bfeef342 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:27.568853 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4336d55b-da9e-4573-a2e0-a128bfeef342 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:27.569318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4336d55b-da9e-4573-a2e0-a128bfeef342 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:27.674483 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=91 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:27.696405 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4336d55b-da9e-4573-a2e0-a128bfeef342 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:27.703773 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4336d55b-da9e-4573-a2e0-a128bfeef342 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.147402 Jun 21 08:18:27.704326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 255/479] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:27 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:27.749538 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=34 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:27.880851 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-518ac830-4430-4f99-ad46-bd3384de4b96 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:27.881507 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-518ac830-4430-4f99-ad46-bd3384de4b96 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:27.887883 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-518ac830-4430-4f99-ad46-bd3384de4b96 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:27.888333 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-518ac830-4430-4f99-ad46-bd3384de4b96 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:27.889096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-518ac830-4430-4f99-ad46-bd3384de4b96 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:27.889529 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-518ac830-4430-4f99-ad46-bd3384de4b96 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:28.015952 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-518ac830-4430-4f99-ad46-bd3384de4b96 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:28.024017 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-518ac830-4430-4f99-ad46-bd3384de4b96 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.147779 Jun 21 08:18:28.024792 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 256/480] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:27 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:28.354681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-41d075e1-1598-4a4c-986a-b5bbccbc7e97 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:28.355294 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-41d075e1-1598-4a4c-986a-b5bbccbc7e97 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:28.361166 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41d075e1-1598-4a4c-986a-b5bbccbc7e97 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:28.361608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41d075e1-1598-4a4c-986a-b5bbccbc7e97 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:28.362357 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41d075e1-1598-4a4c-986a-b5bbccbc7e97 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:28.366558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41d075e1-1598-4a4c-986a-b5bbccbc7e97 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:28.494560 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-41d075e1-1598-4a4c-986a-b5bbccbc7e97 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:28.503546 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-41d075e1-1598-4a4c-986a-b5bbccbc7e97 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.152655 Jun 21 08:18:28.504814 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 257/481] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:28 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:28.721254 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e3dda19c-b27f-444a-8a70-6fa16fad1981 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:28.721873 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e3dda19c-b27f-444a-8a70-6fa16fad1981 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:28.728431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3dda19c-b27f-444a-8a70-6fa16fad1981 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:28.728878 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3dda19c-b27f-444a-8a70-6fa16fad1981 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:28.729631 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3dda19c-b27f-444a-8a70-6fa16fad1981 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:28.730066 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3dda19c-b27f-444a-8a70-6fa16fad1981 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:28.858759 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e3dda19c-b27f-444a-8a70-6fa16fad1981 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:28.866510 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e3dda19c-b27f-444a-8a70-6fa16fad1981 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.149107 Jun 21 08:18:28.867090 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 258/482] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:28 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:29.040266 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-33b219a5-1a29-4651-8db0-3740e93e31df tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:29.040886 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-33b219a5-1a29-4651-8db0-3740e93e31df tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:29.047213 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-33b219a5-1a29-4651-8db0-3740e93e31df tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:29.047659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-33b219a5-1a29-4651-8db0-3740e93e31df tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:29.048447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-33b219a5-1a29-4651-8db0-3740e93e31df tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:29.048879 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-33b219a5-1a29-4651-8db0-3740e93e31df tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:29.181249 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-33b219a5-1a29-4651-8db0-3740e93e31df tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:29.188711 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-33b219a5-1a29-4651-8db0-3740e93e31df tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.152277 Jun 21 08:18:29.189272 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 259/483] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:29 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:29.521132 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7e019abe-d71a-4b48-9aa1-03419042f957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:29.521744 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7e019abe-d71a-4b48-9aa1-03419042f957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:29.527767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7e019abe-d71a-4b48-9aa1-03419042f957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:29.528208 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7e019abe-d71a-4b48-9aa1-03419042f957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:29.528958 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7e019abe-d71a-4b48-9aa1-03419042f957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:29.529386 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7e019abe-d71a-4b48-9aa1-03419042f957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:29.658138 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7e019abe-d71a-4b48-9aa1-03419042f957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:29.666729 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7e019abe-d71a-4b48-9aa1-03419042f957 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.149505 Jun 21 08:18:29.667295 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 260/484] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:29 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:29.883567 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-169a6151-4dfb-43cc-b07f-baa3a1c03117 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:29.884145 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-169a6151-4dfb-43cc-b07f-baa3a1c03117 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:29.890058 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-169a6151-4dfb-43cc-b07f-baa3a1c03117 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:29.890506 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-169a6151-4dfb-43cc-b07f-baa3a1c03117 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:29.891298 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-169a6151-4dfb-43cc-b07f-baa3a1c03117 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:29.891744 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-169a6151-4dfb-43cc-b07f-baa3a1c03117 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:30.021634 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-169a6151-4dfb-43cc-b07f-baa3a1c03117 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:30.029043 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-169a6151-4dfb-43cc-b07f-baa3a1c03117 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.149476 Jun 21 08:18:30.029616 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 261/485] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:29 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:30.205580 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7e0fd6f1-f983-434d-a905-ba985961d6d0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:30.206124 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7e0fd6f1-f983-434d-a905-ba985961d6d0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:30.212969 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7e0fd6f1-f983-434d-a905-ba985961d6d0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:30.213414 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7e0fd6f1-f983-434d-a905-ba985961d6d0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:30.214167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7e0fd6f1-f983-434d-a905-ba985961d6d0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:30.214598 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7e0fd6f1-f983-434d-a905-ba985961d6d0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:30.342579 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7e0fd6f1-f983-434d-a905-ba985961d6d0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:30.350247 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7e0fd6f1-f983-434d-a905-ba985961d6d0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.148473 Jun 21 08:18:30.350838 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 262/486] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:30 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:30.682877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-759dd3bf-b9af-4440-85dc-cc9b511f4ba1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:30.683514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-759dd3bf-b9af-4440-85dc-cc9b511f4ba1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:30.689504 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-759dd3bf-b9af-4440-85dc-cc9b511f4ba1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:30.689956 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-759dd3bf-b9af-4440-85dc-cc9b511f4ba1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:30.690736 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-759dd3bf-b9af-4440-85dc-cc9b511f4ba1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:30.691306 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-759dd3bf-b9af-4440-85dc-cc9b511f4ba1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:30.816926 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-759dd3bf-b9af-4440-85dc-cc9b511f4ba1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:30.824892 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-759dd3bf-b9af-4440-85dc-cc9b511f4ba1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.145869 Jun 21 08:18:30.825389 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 263/487] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:30 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:31.045205 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8d12a2f4-e2c4-4851-96ba-f96e8d25e412 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:31.045855 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8d12a2f4-e2c4-4851-96ba-f96e8d25e412 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:31.052289 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8d12a2f4-e2c4-4851-96ba-f96e8d25e412 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:31.052738 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8d12a2f4-e2c4-4851-96ba-f96e8d25e412 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:31.053493 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8d12a2f4-e2c4-4851-96ba-f96e8d25e412 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:31.053929 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8d12a2f4-e2c4-4851-96ba-f96e8d25e412 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:31.182425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8d12a2f4-e2c4-4851-96ba-f96e8d25e412 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:31.185839 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:31.190213 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8d12a2f4-e2c4-4851-96ba-f96e8d25e412 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.148860 Jun 21 08:18:31.190795 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 264/488] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:31 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:31.367397 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c4248ab7-769d-479e-bfec-e959b11a71ea tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:31.368010 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c4248ab7-769d-479e-bfec-e959b11a71ea tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:31.374289 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c4248ab7-769d-479e-bfec-e959b11a71ea tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:31.374758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c4248ab7-769d-479e-bfec-e959b11a71ea tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:31.375763 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c4248ab7-769d-479e-bfec-e959b11a71ea tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:31.376192 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c4248ab7-769d-479e-bfec-e959b11a71ea tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:31.505225 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c4248ab7-769d-479e-bfec-e959b11a71ea tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:31.512571 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c4248ab7-769d-479e-bfec-e959b11a71ea tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.149651 Jun 21 08:18:31.513121 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 265/489] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:31 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:31.842593 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-55a36f3d-d381-4c85-9c7b-8d8aa2ddab06 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:31.843224 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-55a36f3d-d381-4c85-9c7b-8d8aa2ddab06 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:31.849840 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-55a36f3d-d381-4c85-9c7b-8d8aa2ddab06 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:31.850280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-55a36f3d-d381-4c85-9c7b-8d8aa2ddab06 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:31.851067 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-55a36f3d-d381-4c85-9c7b-8d8aa2ddab06 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:31.851497 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-55a36f3d-d381-4c85-9c7b-8d8aa2ddab06 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:31.986729 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-55a36f3d-d381-4c85-9c7b-8d8aa2ddab06 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:31.994595 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-55a36f3d-d381-4c85-9c7b-8d8aa2ddab06 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.155760 Jun 21 08:18:31.995123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 266/490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:31 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:32.207997 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f158ea72-1c82-40a7-8406-8b85c3a1bb76 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:32.208686 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f158ea72-1c82-40a7-8406-8b85c3a1bb76 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:32.214544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f158ea72-1c82-40a7-8406-8b85c3a1bb76 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:32.215013 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f158ea72-1c82-40a7-8406-8b85c3a1bb76 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:32.215792 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f158ea72-1c82-40a7-8406-8b85c3a1bb76 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:32.216223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f158ea72-1c82-40a7-8406-8b85c3a1bb76 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:32.345240 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f158ea72-1c82-40a7-8406-8b85c3a1bb76 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:32.352826 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f158ea72-1c82-40a7-8406-8b85c3a1bb76 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.149085 Jun 21 08:18:32.353385 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 267/491] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:32 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:32.530089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b460984c-4612-45de-a284-b6ece2f71f4b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:32.530731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b460984c-4612-45de-a284-b6ece2f71f4b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:32.536796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b460984c-4612-45de-a284-b6ece2f71f4b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:32.537232 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b460984c-4612-45de-a284-b6ece2f71f4b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:32.537982 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b460984c-4612-45de-a284-b6ece2f71f4b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:32.538411 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b460984c-4612-45de-a284-b6ece2f71f4b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:32.666017 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b460984c-4612-45de-a284-b6ece2f71f4b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:32.673440 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b460984c-4612-45de-a284-b6ece2f71f4b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.147237 Jun 21 08:18:32.674003 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 268/492] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:32 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:33.010693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7b43d3d5-872c-4782-ad30-4670e2006fd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:33.011317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7b43d3d5-872c-4782-ad30-4670e2006fd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:33.017435 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b43d3d5-872c-4782-ad30-4670e2006fd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:33.017884 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b43d3d5-872c-4782-ad30-4670e2006fd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:33.018668 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b43d3d5-872c-4782-ad30-4670e2006fd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:33.019108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b43d3d5-872c-4782-ad30-4670e2006fd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:33.148819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7b43d3d5-872c-4782-ad30-4670e2006fd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:33.156556 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7b43d3d5-872c-4782-ad30-4670e2006fd8 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.149744 Jun 21 08:18:33.157108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 269/493] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:33 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:33.370159 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-59db32b4-1e3a-43c6-89d9-ffe6f018e928 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:33.370885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-59db32b4-1e3a-43c6-89d9-ffe6f018e928 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:33.377021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-59db32b4-1e3a-43c6-89d9-ffe6f018e928 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:33.377464 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-59db32b4-1e3a-43c6-89d9-ffe6f018e928 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:33.378222 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-59db32b4-1e3a-43c6-89d9-ffe6f018e928 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:33.379271 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-59db32b4-1e3a-43c6-89d9-ffe6f018e928 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:33.512593 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-59db32b4-1e3a-43c6-89d9-ffe6f018e928 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:33.520245 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-59db32b4-1e3a-43c6-89d9-ffe6f018e928 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.153984 Jun 21 08:18:33.521002 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 270/494] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:33 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:33.690346 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dbca67fd-a24f-444f-ab5c-8632874160b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:33.690982 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-dbca67fd-a24f-444f-ab5c-8632874160b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:33.696885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dbca67fd-a24f-444f-ab5c-8632874160b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:33.697333 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dbca67fd-a24f-444f-ab5c-8632874160b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:33.698082 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dbca67fd-a24f-444f-ab5c-8632874160b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:33.698511 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dbca67fd-a24f-444f-ab5c-8632874160b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:33.830123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-dbca67fd-a24f-444f-ab5c-8632874160b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:33.838534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-dbca67fd-a24f-444f-ab5c-8632874160b6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.151957 Jun 21 08:18:33.839127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 271/495] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:33 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:34.173298 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-41fe433e-7eed-427a-9b49-8b619b34c205 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:34.173857 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-41fe433e-7eed-427a-9b49-8b619b34c205 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:34.179881 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41fe433e-7eed-427a-9b49-8b619b34c205 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:34.180329 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41fe433e-7eed-427a-9b49-8b619b34c205 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:34.181491 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41fe433e-7eed-427a-9b49-8b619b34c205 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:34.181937 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41fe433e-7eed-427a-9b49-8b619b34c205 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:34.327806 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-41fe433e-7eed-427a-9b49-8b619b34c205 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:34.336326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-41fe433e-7eed-427a-9b49-8b619b34c205 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.166941 Jun 21 08:18:34.338981 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 272/496] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:34 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:34.537713 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0de6a54a-4b5a-4ba8-8c39-9c86fcc948b8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:34.538393 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0de6a54a-4b5a-4ba8-8c39-9c86fcc948b8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:34.544832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0de6a54a-4b5a-4ba8-8c39-9c86fcc948b8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:34.545278 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0de6a54a-4b5a-4ba8-8c39-9c86fcc948b8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:34.546053 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0de6a54a-4b5a-4ba8-8c39-9c86fcc948b8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:34.546485 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0de6a54a-4b5a-4ba8-8c39-9c86fcc948b8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:34.687888 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0de6a54a-4b5a-4ba8-8c39-9c86fcc948b8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:34.696876 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0de6a54a-4b5a-4ba8-8c39-9c86fcc948b8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.163633 Jun 21 08:18:34.697778 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 273/497] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:34 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:34.854516 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4696713a-12be-4140-bd6a-0b81912781f8 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:34.855180 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4696713a-12be-4140-bd6a-0b81912781f8 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:34.861157 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4696713a-12be-4140-bd6a-0b81912781f8 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:34.861611 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4696713a-12be-4140-bd6a-0b81912781f8 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:34.862371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4696713a-12be-4140-bd6a-0b81912781f8 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:34.862836 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4696713a-12be-4140-bd6a-0b81912781f8 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:35.002968 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4696713a-12be-4140-bd6a-0b81912781f8 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:35.011572 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4696713a-12be-4140-bd6a-0b81912781f8 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.160807 Jun 21 08:18:35.012135 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 274/498] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:34 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:35.353630 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4c2f0854-fa1d-4a20-884e-9bc054ee093a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:35.354239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4c2f0854-fa1d-4a20-884e-9bc054ee093a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:35.360185 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4c2f0854-fa1d-4a20-884e-9bc054ee093a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:35.360634 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4c2f0854-fa1d-4a20-884e-9bc054ee093a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:35.361384 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4c2f0854-fa1d-4a20-884e-9bc054ee093a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:35.361819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4c2f0854-fa1d-4a20-884e-9bc054ee093a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:35.492587 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4c2f0854-fa1d-4a20-884e-9bc054ee093a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:35.500726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4c2f0854-fa1d-4a20-884e-9bc054ee093a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.150738 Jun 21 08:18:35.501294 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 275/499] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:35 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:35.713416 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6e16e478-0978-4208-b99a-4b05055d146c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:35.714048 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6e16e478-0978-4208-b99a-4b05055d146c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:35.720072 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e16e478-0978-4208-b99a-4b05055d146c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:35.720498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e16e478-0978-4208-b99a-4b05055d146c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:35.721244 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e16e478-0978-4208-b99a-4b05055d146c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:35.721671 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e16e478-0978-4208-b99a-4b05055d146c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:35.852742 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-6e16e478-0978-4208-b99a-4b05055d146c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:35.861327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6e16e478-0978-4208-b99a-4b05055d146c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.151730 Jun 21 08:18:35.861904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 276/500] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:35 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:36.027474 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-685189a8-ac31-40e9-a805-9eb1347a43a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:36.028082 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-685189a8-ac31-40e9-a805-9eb1347a43a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:36.034002 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-685189a8-ac31-40e9-a805-9eb1347a43a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:36.034470 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-685189a8-ac31-40e9-a805-9eb1347a43a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:36.036106 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-685189a8-ac31-40e9-a805-9eb1347a43a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:36.036527 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-685189a8-ac31-40e9-a805-9eb1347a43a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:36.170508 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-685189a8-ac31-40e9-a805-9eb1347a43a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:36.180065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-685189a8-ac31-40e9-a805-9eb1347a43a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.156409 Jun 21 08:18:36.180630 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 277/501] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:36 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:36.517243 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fd325342-59e7-44c4-98e8-3480f309e3e6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:36.517844 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fd325342-59e7-44c4-98e8-3480f309e3e6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:36.524366 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fd325342-59e7-44c4-98e8-3480f309e3e6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:36.524809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fd325342-59e7-44c4-98e8-3480f309e3e6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:36.525612 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fd325342-59e7-44c4-98e8-3480f309e3e6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:36.526040 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fd325342-59e7-44c4-98e8-3480f309e3e6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:36.656207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fd325342-59e7-44c4-98e8-3480f309e3e6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:36.664727 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fd325342-59e7-44c4-98e8-3480f309e3e6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.151341 Jun 21 08:18:36.665284 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 278/502] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:36 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:36.889068 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c555c92e-7963-41a9-9702-017d2c88670c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:36.889708 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c555c92e-7963-41a9-9702-017d2c88670c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:36.896240 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c555c92e-7963-41a9-9702-017d2c88670c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:36.896676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c555c92e-7963-41a9-9702-017d2c88670c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:36.897423 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c555c92e-7963-41a9-9702-017d2c88670c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:36.897852 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c555c92e-7963-41a9-9702-017d2c88670c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:37.028344 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c555c92e-7963-41a9-9702-017d2c88670c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:37.036129 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c555c92e-7963-41a9-9702-017d2c88670c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.150770 Jun 21 08:18:37.036684 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 279/503] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:36 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:37.196817 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ac45ae81-4551-4611-bd2e-4c834e1e4cdf tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:37.197375 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ac45ae81-4551-4611-bd2e-4c834e1e4cdf tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:37.203505 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ac45ae81-4551-4611-bd2e-4c834e1e4cdf tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:37.203948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ac45ae81-4551-4611-bd2e-4c834e1e4cdf tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:37.204695 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ac45ae81-4551-4611-bd2e-4c834e1e4cdf tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:37.205121 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ac45ae81-4551-4611-bd2e-4c834e1e4cdf tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:37.340636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ac45ae81-4551-4611-bd2e-4c834e1e4cdf tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:37.348140 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ac45ae81-4551-4611-bd2e-4c834e1e4cdf tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.155314 Jun 21 08:18:37.348690 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 280/504] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:37 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:37.682387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c4022987-5791-4305-a401-ca2d30aba8b2 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:37.683033 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c4022987-5791-4305-a401-ca2d30aba8b2 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:37.689135 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c4022987-5791-4305-a401-ca2d30aba8b2 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:37.689589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c4022987-5791-4305-a401-ca2d30aba8b2 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:37.690355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c4022987-5791-4305-a401-ca2d30aba8b2 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:37.690826 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c4022987-5791-4305-a401-ca2d30aba8b2 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:37.708291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:37.824720 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c4022987-5791-4305-a401-ca2d30aba8b2 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:37.833170 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c4022987-5791-4305-a401-ca2d30aba8b2 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.154710 Jun 21 08:18:37.833707 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 281/505] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:37 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:38.053560 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e3ef2765-522e-4dd3-9334-08a5683ff21d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:38.054211 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e3ef2765-522e-4dd3-9334-08a5683ff21d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:38.060214 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3ef2765-522e-4dd3-9334-08a5683ff21d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:38.060654 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3ef2765-522e-4dd3-9334-08a5683ff21d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:38.061398 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3ef2765-522e-4dd3-9334-08a5683ff21d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:38.061826 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3ef2765-522e-4dd3-9334-08a5683ff21d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:38.196838 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e3ef2765-522e-4dd3-9334-08a5683ff21d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:38.205838 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e3ef2765-522e-4dd3-9334-08a5683ff21d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.156629 Jun 21 08:18:38.206396 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 282/506] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:38 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:38.365433 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ee1bd19d-4d25-473f-b133-971537ad4137 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:38.366010 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ee1bd19d-4d25-473f-b133-971537ad4137 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:38.372739 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee1bd19d-4d25-473f-b133-971537ad4137 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:38.373194 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee1bd19d-4d25-473f-b133-971537ad4137 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:38.374008 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee1bd19d-4d25-473f-b133-971537ad4137 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:38.374586 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee1bd19d-4d25-473f-b133-971537ad4137 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:38.517862 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ee1bd19d-4d25-473f-b133-971537ad4137 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:38.530127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ee1bd19d-4d25-473f-b133-971537ad4137 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.168992 Jun 21 08:18:38.531025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 283/507] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:38 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:38.850643 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-94f99489-7e3c-43b7-9b35-db826c29d480 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:38.851295 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-94f99489-7e3c-43b7-9b35-db826c29d480 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:38.857623 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-94f99489-7e3c-43b7-9b35-db826c29d480 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:38.858075 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-94f99489-7e3c-43b7-9b35-db826c29d480 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:38.858878 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-94f99489-7e3c-43b7-9b35-db826c29d480 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:38.859319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-94f99489-7e3c-43b7-9b35-db826c29d480 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:38.999641 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-94f99489-7e3c-43b7-9b35-db826c29d480 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:39.008708 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-94f99489-7e3c-43b7-9b35-db826c29d480 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.163291 Jun 21 08:18:39.009273 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 284/508] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:38 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:39.223623 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0aac55a3-c8f3-469f-880a-96bc4423d2da tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:39.224228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0aac55a3-c8f3-469f-880a-96bc4423d2da tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:39.230125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0aac55a3-c8f3-469f-880a-96bc4423d2da tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:39.230585 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0aac55a3-c8f3-469f-880a-96bc4423d2da tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:39.231377 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0aac55a3-c8f3-469f-880a-96bc4423d2da tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:39.231808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0aac55a3-c8f3-469f-880a-96bc4423d2da tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:39.363683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0aac55a3-c8f3-469f-880a-96bc4423d2da tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:39.371836 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0aac55a3-c8f3-469f-880a-96bc4423d2da tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.152279 Jun 21 08:18:39.372413 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 285/509] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:39 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:39.551979 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7cceda6c-112b-4d25-b815-2f6c5d47809b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:39.552592 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7cceda6c-112b-4d25-b815-2f6c5d47809b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:39.558472 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7cceda6c-112b-4d25-b815-2f6c5d47809b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:39.558949 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7cceda6c-112b-4d25-b815-2f6c5d47809b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:39.559700 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7cceda6c-112b-4d25-b815-2f6c5d47809b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:39.560136 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7cceda6c-112b-4d25-b815-2f6c5d47809b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:39.692079 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7cceda6c-112b-4d25-b815-2f6c5d47809b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:39.700684 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7cceda6c-112b-4d25-b815-2f6c5d47809b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.152496 Jun 21 08:18:39.701265 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 286/510] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:39 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:40.025274 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-341f6a4f-7f7d-4039-8df7-8d1f69d6a072 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:40.025925 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-341f6a4f-7f7d-4039-8df7-8d1f69d6a072 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:40.031902 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-341f6a4f-7f7d-4039-8df7-8d1f69d6a072 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:40.032353 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-341f6a4f-7f7d-4039-8df7-8d1f69d6a072 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:40.033112 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-341f6a4f-7f7d-4039-8df7-8d1f69d6a072 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:40.033550 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-341f6a4f-7f7d-4039-8df7-8d1f69d6a072 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:40.179229 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-341f6a4f-7f7d-4039-8df7-8d1f69d6a072 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:40.188304 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-341f6a4f-7f7d-4039-8df7-8d1f69d6a072 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.166826 Jun 21 08:18:40.189147 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 287/511] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:40 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:40.240175 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c5a56a0a-c45c-4e5f-8caa-5b8f930f9155 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "POST /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 22.573704 Jun 21 08:18:40.241627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 225/512] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:18:17 2022] POST /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments => generated 194 bytes in 22576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:40.388843 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ef816772-1447-4b0a-9527-0a15248cbee4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:40.390360 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ef816772-1447-4b0a-9527-0a15248cbee4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:40.397692 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef816772-1447-4b0a-9527-0a15248cbee4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:40.399230 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef816772-1447-4b0a-9527-0a15248cbee4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:40.400220 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef816772-1447-4b0a-9527-0a15248cbee4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:40.400794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef816772-1447-4b0a-9527-0a15248cbee4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:40.470047 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-fd3479f5-39a1-4c78-8785-16b696e90025 req-5da5932b-e9d4-4137-9b66-80d1e41ceba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9636db4b-57b1-4e11-832b-584baecd8ed2", "name": "network-vif-plugged", "status": "completed", "tag": "2cf35fad-280a-42ee-a53d-2d69eb288575"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:40.482935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-fd3479f5-39a1-4c78-8785-16b696e90025 req-5da5932b-e9d4-4137-9b66-80d1e41ceba8 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:40.484385 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-fd3479f5-39a1-4c78-8785-16b696e90025 req-5da5932b-e9d4-4137-9b66-80d1e41ceba8 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:40.504337 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-fd3479f5-39a1-4c78-8785-16b696e90025 req-5da5932b-e9d4-4137-9b66-80d1e41ceba8 service nova] Creating event network-vif-plugged:2cf35fad-280a-42ee-a53d-2d69eb288575 for instance 9636db4b-57b1-4e11-832b-584baecd8ed2 on hv-cinder-83697 Jun 21 08:18:40.515119 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-fd3479f5-39a1-4c78-8785-16b696e90025 req-5da5932b-e9d4-4137-9b66-80d1e41ceba8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049347 Jun 21 08:18:40.516283 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 226/513] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:40.581153 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ef816772-1447-4b0a-9527-0a15248cbee4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:40.590544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ef816772-1447-4b0a-9527-0a15248cbee4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.205457 Jun 21 08:18:40.591530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 288/514] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:40 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:40.720297 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-aef484e1-1a2b-4f97-b2c4-a1c3eb124486 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:40.721092 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-aef484e1-1a2b-4f97-b2c4-a1c3eb124486 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:40.727740 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aef484e1-1a2b-4f97-b2c4-a1c3eb124486 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:40.728193 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aef484e1-1a2b-4f97-b2c4-a1c3eb124486 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:40.728954 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aef484e1-1a2b-4f97-b2c4-a1c3eb124486 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:40.729385 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aef484e1-1a2b-4f97-b2c4-a1c3eb124486 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:41.040997 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-aef484e1-1a2b-4f97-b2c4-a1c3eb124486 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:41.048708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-aef484e1-1a2b-4f97-b2c4-a1c3eb124486 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.333336 Jun 21 08:18:41.049348 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 227/515] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:40 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:41.206288 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ff5fd3c2-dea0-4e81-b380-73a586a3861c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:41.207905 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ff5fd3c2-dea0-4e81-b380-73a586a3861c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:41.215068 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ff5fd3c2-dea0-4e81-b380-73a586a3861c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:41.215536 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ff5fd3c2-dea0-4e81-b380-73a586a3861c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:41.216302 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ff5fd3c2-dea0-4e81-b380-73a586a3861c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:41.216736 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ff5fd3c2-dea0-4e81-b380-73a586a3861c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:41.393846 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ff5fd3c2-dea0-4e81-b380-73a586a3861c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:41.402961 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ff5fd3c2-dea0-4e81-b380-73a586a3861c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1710 microversion: 2.1 time: 0.201421 Jun 21 08:18:41.403785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 289/516] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:41 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1710 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:41.608315 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2005e159-eb5d-4b4a-9b8d-7babde0871aa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:41.608857 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2005e159-eb5d-4b4a-9b8d-7babde0871aa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:41.615768 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2005e159-eb5d-4b4a-9b8d-7babde0871aa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:41.616219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2005e159-eb5d-4b4a-9b8d-7babde0871aa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:41.616982 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2005e159-eb5d-4b4a-9b8d-7babde0871aa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:41.617422 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2005e159-eb5d-4b4a-9b8d-7babde0871aa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:41.744263 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2005e159-eb5d-4b4a-9b8d-7babde0871aa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:41.753998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2005e159-eb5d-4b4a-9b8d-7babde0871aa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.149445 Jun 21 08:18:41.754876 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 228/517] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:41 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:42.065914 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ee933886-6571-4a15-bbc0-28aa7b6b7445 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:42.067079 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ee933886-6571-4a15-bbc0-28aa7b6b7445 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:42.073013 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee933886-6571-4a15-bbc0-28aa7b6b7445 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:42.073454 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee933886-6571-4a15-bbc0-28aa7b6b7445 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:42.074202 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee933886-6571-4a15-bbc0-28aa7b6b7445 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:42.074643 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ee933886-6571-4a15-bbc0-28aa7b6b7445 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:42.209850 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ee933886-6571-4a15-bbc0-28aa7b6b7445 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:42.217337 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ee933886-6571-4a15-bbc0-28aa7b6b7445 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.155275 Jun 21 08:18:42.217889 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 290/518] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:42 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:42.423616 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fa984b71-2ea8-46e2-90d2-57959f1bf72b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:42.424559 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-fa984b71-2ea8-46e2-90d2-57959f1bf72b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:42.432421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fa984b71-2ea8-46e2-90d2-57959f1bf72b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:42.432951 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fa984b71-2ea8-46e2-90d2-57959f1bf72b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:42.433797 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fa984b71-2ea8-46e2-90d2-57959f1bf72b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:42.434482 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fa984b71-2ea8-46e2-90d2-57959f1bf72b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:42.584104 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fa984b71-2ea8-46e2-90d2-57959f1bf72b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:42.592670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fa984b71-2ea8-46e2-90d2-57959f1bf72b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1714 microversion: 2.1 time: 0.175070 Jun 21 08:18:42.593318 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 229/519] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:42 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1714 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:42.772547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e9edbf4a-7e57-4c8a-8b77-da6ce8a10285 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:42.773196 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e9edbf4a-7e57-4c8a-8b77-da6ce8a10285 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:42.779824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e9edbf4a-7e57-4c8a-8b77-da6ce8a10285 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:42.780270 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e9edbf4a-7e57-4c8a-8b77-da6ce8a10285 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:42.781026 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e9edbf4a-7e57-4c8a-8b77-da6ce8a10285 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:42.781460 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e9edbf4a-7e57-4c8a-8b77-da6ce8a10285 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:42.926529 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e9edbf4a-7e57-4c8a-8b77-da6ce8a10285 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:42.934877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e9edbf4a-7e57-4c8a-8b77-da6ce8a10285 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1370 microversion: 2.1 time: 0.166823 Jun 21 08:18:42.939315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 291/520] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:42 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:43.233124 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-746d0b2f-10d8-4909-83a1-c47621725c94 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:43.233733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-746d0b2f-10d8-4909-83a1-c47621725c94 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:43.240709 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-746d0b2f-10d8-4909-83a1-c47621725c94 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:43.241158 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-746d0b2f-10d8-4909-83a1-c47621725c94 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:43.241911 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-746d0b2f-10d8-4909-83a1-c47621725c94 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:43.242341 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-746d0b2f-10d8-4909-83a1-c47621725c94 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:43.371808 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-746d0b2f-10d8-4909-83a1-c47621725c94 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:43.380037 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-746d0b2f-10d8-4909-83a1-c47621725c94 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.150752 Jun 21 08:18:43.380596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 230/521] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:43 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:43.952679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dd0fe3b4-0bde-4cf7-875d-ac9c59ce85e1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:43.953413 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-dd0fe3b4-0bde-4cf7-875d-ac9c59ce85e1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:43.960063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd0fe3b4-0bde-4cf7-875d-ac9c59ce85e1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:43.960500 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd0fe3b4-0bde-4cf7-875d-ac9c59ce85e1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:43.961257 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd0fe3b4-0bde-4cf7-875d-ac9c59ce85e1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:43.961713 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd0fe3b4-0bde-4cf7-875d-ac9c59ce85e1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:44.108766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-dd0fe3b4-0bde-4cf7-875d-ac9c59ce85e1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:44.117463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-dd0fe3b4-0bde-4cf7-875d-ac9c59ce85e1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1565 microversion: 2.1 time: 0.168558 Jun 21 08:18:44.118058 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 292/522] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:43 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:44.134921 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-16051d2b-c091-4251-a69d-6f5fe8ae5bdd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:44.135402 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-16051d2b-c091-4251-a69d-6f5fe8ae5bdd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:44.141716 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-16051d2b-c091-4251-a69d-6f5fe8ae5bdd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:44.142159 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-16051d2b-c091-4251-a69d-6f5fe8ae5bdd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:44.142944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-16051d2b-c091-4251-a69d-6f5fe8ae5bdd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:44.143367 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-16051d2b-c091-4251-a69d-6f5fe8ae5bdd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:44.223999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-16051d2b-c091-4251-a69d-6f5fe8ae5bdd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092306 Jun 21 08:18:44.224662 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 231/523] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 08:18:44 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:44.398033 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-db99539c-c2f5-49de-9b92-7bcb61f7e3c7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:44.398838 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-db99539c-c2f5-49de-9b92-7bcb61f7e3c7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:44.405036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db99539c-c2f5-49de-9b92-7bcb61f7e3c7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:44.405589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db99539c-c2f5-49de-9b92-7bcb61f7e3c7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:44.406606 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db99539c-c2f5-49de-9b92-7bcb61f7e3c7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:44.407260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db99539c-c2f5-49de-9b92-7bcb61f7e3c7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:44.431645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-fb953155-757e-4647-929b-156669b0b06c req-35f61a2f-f3e9-4470-8cdf-00bcb352b063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d983b34e-0d69-4afd-9bb6-f13213be6bb1", "name": "network-vif-plugged", "status": "completed", "tag": "db75733d-f744-4c74-924b-254ed8090967"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:44.451500 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-fb953155-757e-4647-929b-156669b0b06c req-35f61a2f-f3e9-4470-8cdf-00bcb352b063 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:44.452409 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-fb953155-757e-4647-929b-156669b0b06c req-35f61a2f-f3e9-4470-8cdf-00bcb352b063 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:44.465909 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-fb953155-757e-4647-929b-156669b0b06c req-35f61a2f-f3e9-4470-8cdf-00bcb352b063 service nova] Creating event network-vif-plugged:db75733d-f744-4c74-924b-254ed8090967 for instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 on hv-cinder-83697 Jun 21 08:18:44.471675 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-fb953155-757e-4647-929b-156669b0b06c req-35f61a2f-f3e9-4470-8cdf-00bcb352b063 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048654 Jun 21 08:18:44.473422 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 232/524] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:18:44.560669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-db99539c-c2f5-49de-9b92-7bcb61f7e3c7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:44.569186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-db99539c-c2f5-49de-9b92-7bcb61f7e3c7 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.176291 Jun 21 08:18:44.578953 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 293/525] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:44 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:45.501920 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-cdff0b9b-560b-4b36-b28c-209c79ceed66 req-79f77856-a500-4241-96cb-76a0f322f118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9636db4b-57b1-4e11-832b-584baecd8ed2", "tag": "2cf35fad-280a-42ee-a53d-2d69eb288575"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:45.510692 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-cdff0b9b-560b-4b36-b28c-209c79ceed66 req-79f77856-a500-4241-96cb-76a0f322f118 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:45.511139 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-cdff0b9b-560b-4b36-b28c-209c79ceed66 req-79f77856-a500-4241-96cb-76a0f322f118 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:45.522860 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-cdff0b9b-560b-4b36-b28c-209c79ceed66 req-79f77856-a500-4241-96cb-76a0f322f118 service nova] Creating event network-changed:2cf35fad-280a-42ee-a53d-2d69eb288575 for instance 9636db4b-57b1-4e11-832b-584baecd8ed2 on hv-cinder-83697 Jun 21 08:18:45.527629 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-cdff0b9b-560b-4b36-b28c-209c79ceed66 req-79f77856-a500-4241-96cb-76a0f322f118 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030063 Jun 21 08:18:45.528217 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 233/526] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:45.586216 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0d5272f4-709b-48a0-8783-e62ebdaa98a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:45.587698 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0d5272f4-709b-48a0-8783-e62ebdaa98a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:45.595563 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0d5272f4-709b-48a0-8783-e62ebdaa98a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:45.596255 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0d5272f4-709b-48a0-8783-e62ebdaa98a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:45.598718 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0d5272f4-709b-48a0-8783-e62ebdaa98a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:45.599448 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0d5272f4-709b-48a0-8783-e62ebdaa98a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:45.742201 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0d5272f4-709b-48a0-8783-e62ebdaa98a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:45.750064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0d5272f4-709b-48a0-8783-e62ebdaa98a5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.168289 Jun 21 08:18:45.751031 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 294/527] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:45 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:46.768941 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-553b442f-57b1-4f2e-9c0c-6a95c2b8584b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:46.769686 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-553b442f-57b1-4f2e-9c0c-6a95c2b8584b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:46.775815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-553b442f-57b1-4f2e-9c0c-6a95c2b8584b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:46.776252 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-553b442f-57b1-4f2e-9c0c-6a95c2b8584b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:46.776996 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-553b442f-57b1-4f2e-9c0c-6a95c2b8584b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:46.777420 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-553b442f-57b1-4f2e-9c0c-6a95c2b8584b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:46.969725 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-553b442f-57b1-4f2e-9c0c-6a95c2b8584b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:46.978239 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-553b442f-57b1-4f2e-9c0c-6a95c2b8584b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1261 microversion: 2.1 time: 0.214059 Jun 21 08:18:46.978835 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 234/528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:46 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:47.994741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5ab54e73-2480-4c42-ab26-673c180e3b65 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:47.995362 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5ab54e73-2480-4c42-ab26-673c180e3b65 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:48.001863 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5ab54e73-2480-4c42-ab26-673c180e3b65 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:48.002312 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5ab54e73-2480-4c42-ab26-673c180e3b65 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:48.003103 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5ab54e73-2480-4c42-ab26-673c180e3b65 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:48.003540 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5ab54e73-2480-4c42-ab26-673c180e3b65 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:48.131691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5ab54e73-2480-4c42-ab26-673c180e3b65 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:48.139046 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5ab54e73-2480-4c42-ab26-673c180e3b65 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1446 microversion: 2.1 time: 0.148117 Jun 21 08:18:48.139606 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 295/529] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:47 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:48.155016 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d3939033-c334-40df-bc37-d2e7a5fe7860 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:48.155627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d3939033-c334-40df-bc37-d2e7a5fe7860 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:48.162573 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3939033-c334-40df-bc37-d2e7a5fe7860 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:48.163050 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3939033-c334-40df-bc37-d2e7a5fe7860 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:48.163798 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3939033-c334-40df-bc37-d2e7a5fe7860 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:48.164220 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3939033-c334-40df-bc37-d2e7a5fe7860 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:48.291802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d3939033-c334-40df-bc37-d2e7a5fe7860 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:48.299211 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d3939033-c334-40df-bc37-d2e7a5fe7860 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1446 microversion: 2.1 time: 0.147927 Jun 21 08:18:48.299778 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 235/530] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:48 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:49.810168 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0a65e0eb-eecc-476b-b4ea-87ef06985e42 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:49.810561 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0a65e0eb-eecc-476b-b4ea-87ef06985e42 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:49.816897 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0a65e0eb-eecc-476b-b4ea-87ef06985e42 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:49.817388 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0a65e0eb-eecc-476b-b4ea-87ef06985e42 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:49.818530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0a65e0eb-eecc-476b-b4ea-87ef06985e42 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:49.818998 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0a65e0eb-eecc-476b-b4ea-87ef06985e42 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:49.845101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0a65e0eb-eecc-476b-b4ea-87ef06985e42 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa/ips" status: 200 len: 149 microversion: 2.1 time: 0.039243 Jun 21 08:18:49.852360 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 296/531] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 08:18:49 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:49.858065 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d55be1d6-19e0-41c9-98b2-242e5422ebca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "088f3edb-b15c-4b00-aa78-c16fd4f16dca"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:49.865716 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d55be1d6-19e0-41c9-98b2-242e5422ebca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:49.872670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d55be1d6-19e0-41c9-98b2-242e5422ebca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:49.873120 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d55be1d6-19e0-41c9-98b2-242e5422ebca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:49.873887 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d55be1d6-19e0-41c9-98b2-242e5422ebca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:49.874540 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d55be1d6-19e0-41c9-98b2-242e5422ebca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:49.975397 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-d55be1d6-19e0-41c9-98b2-242e5422ebca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Invalid volume: volume 088f3edb-b15c-4b00-aa78-c16fd4f16dca is already attached to instances: 1c08d704-c754-4c7d-b0f4-540ebde6c782 Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d55be1d6-19e0-41c9-98b2-242e5422ebca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: POST /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa/os-volume_attachments HTTP/1.1 Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 74 Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:18:49.977198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {"volumeAttachment": {"volumeId": "088f3edb-b15c-4b00-aa78-c16fd4f16dca"}} Jun 21 08:18:49.978841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Invalid volume: volume 088f3edb-b15c-4b00-aa78-c16fd4f16dca is already attached to instances: 1c08d704-c754-4c7d-b0f4-540ebde6c782 Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'server_id': '6909a083-0588-4b06-916a-e9b153960ffa', 'body': {'volumeAttachment': {'volumeId': '088f3edb-b15c-4b00-aa78-c16fd4f16dca'}}} Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 088f3edb-b15c-4b00-aa78-c16fd4f16dca is already attached to instances: 1c08d704-c754-4c7d-b0f4-540ebde6c782 Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:18:49.979733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 088f3edb-b15c-4b00-aa78-c16fd4f16dca is already attached to instances: 1c08d704-c754-4c7d-b0f4-540ebde6c782 Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:18:49.981134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:18:49.982596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:18:49.982596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:18:49.982596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:18:49.982596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 088f3edb-b15c-4b00-aa78-c16fd4f16dca is already attached to instances: 1c08d704-c754-4c7d-b0f4-540ebde6c782 Jun 21 08:18:49.982596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:18:49.982596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d55be1d6-19e0-41c9-98b2-242e5422ebca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 400 to user: Invalid volume: volume 088f3edb-b15c-4b00-aa78-c16fd4f16dca is already attached to instances: 1c08d704-c754-4c7d-b0f4-540ebde6c782 {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:18:49.982596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d55be1d6-19e0-41c9-98b2-242e5422ebca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125563 Jun 21 08:18:49.982596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 236/532] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:18:49 2022] POST /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 08:18:49.988612 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-cd459582-e55b-4403-adda-a5a2623cfb3b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:49.989342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-cd459582-e55b-4403-adda-a5a2623cfb3b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:49.995731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-cd459582-e55b-4403-adda-a5a2623cfb3b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:49.996178 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-cd459582-e55b-4403-adda-a5a2623cfb3b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:49.996973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-cd459582-e55b-4403-adda-a5a2623cfb3b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:49.997405 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-cd459582-e55b-4403-adda-a5a2623cfb3b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:50.025819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-cd459582-e55b-4403-adda-a5a2623cfb3b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Going to try to terminate instance {{(pid=117547) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:18:50.054801 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=100 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:50.112507 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-cd459582-e55b-4403-adda-a5a2623cfb3b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 204 len: 0 microversion: 2.1 time: 0.128131 Jun 21 08:18:50.113024 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 297/533] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:18:49 2022] DELETE /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:18:50.122718 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f2b1394c-532b-4a2b-a563-66896a0bd962 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:50.123340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f2b1394c-532b-4a2b-a563-66896a0bd962 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:50.131539 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f2b1394c-532b-4a2b-a563-66896a0bd962 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:50.131989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f2b1394c-532b-4a2b-a563-66896a0bd962 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:50.132763 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f2b1394c-532b-4a2b-a563-66896a0bd962 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:50.133203 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f2b1394c-532b-4a2b-a563-66896a0bd962 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:50.386708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f2b1394c-532b-4a2b-a563-66896a0bd962 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:50.395141 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f2b1394c-532b-4a2b-a563-66896a0bd962 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1681 microversion: 2.1 time: 0.276280 Jun 21 08:18:50.395850 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 237/534] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:50 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1681 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:50.427975 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-fd01f4d5-647d-43c1-9f52-4d2b56ace3e8 req-413e972d-f33f-471b-990c-bdfd1c46fd3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d983b34e-0d69-4afd-9bb6-f13213be6bb1", "tag": "db75733d-f744-4c74-924b-254ed8090967"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:50.436701 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-fd01f4d5-647d-43c1-9f52-4d2b56ace3e8 req-413e972d-f33f-471b-990c-bdfd1c46fd3a service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:50.437148 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-fd01f4d5-647d-43c1-9f52-4d2b56ace3e8 req-413e972d-f33f-471b-990c-bdfd1c46fd3a service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:50.448809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-fd01f4d5-647d-43c1-9f52-4d2b56ace3e8 req-413e972d-f33f-471b-990c-bdfd1c46fd3a service nova] Creating event network-changed:db75733d-f744-4c74-924b-254ed8090967 for instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 on hv-cinder-83697 Jun 21 08:18:50.453659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-fd01f4d5-647d-43c1-9f52-4d2b56ace3e8 req-413e972d-f33f-471b-990c-bdfd1c46fd3a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029850 Jun 21 08:18:50.454392 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 298/535] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:51.414040 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-490b2f83-4237-49c0-b0a9-707a44c94141 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:51.414670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-490b2f83-4237-49c0-b0a9-707a44c94141 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:51.421382 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-490b2f83-4237-49c0-b0a9-707a44c94141 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:51.421830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-490b2f83-4237-49c0-b0a9-707a44c94141 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:51.422593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-490b2f83-4237-49c0-b0a9-707a44c94141 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:51.423045 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-490b2f83-4237-49c0-b0a9-707a44c94141 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:51.557710 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-490b2f83-4237-49c0-b0a9-707a44c94141 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:51.565055 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-490b2f83-4237-49c0-b0a9-707a44c94141 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1681 microversion: 2.1 time: 0.155746 Jun 21 08:18:51.565624 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 238/536] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:51 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:52.112277 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7789992b-560d-4964-b59e-d450f62445bc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:52.115123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7789992b-560d-4964-b59e-d450f62445bc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:52.122284 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7789992b-560d-4964-b59e-d450f62445bc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:52.122958 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7789992b-560d-4964-b59e-d450f62445bc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:52.123853 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7789992b-560d-4964-b59e-d450f62445bc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:52.124289 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7789992b-560d-4964-b59e-d450f62445bc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:52.270806 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7789992b-560d-4964-b59e-d450f62445bc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:52.279482 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7789992b-560d-4964-b59e-d450f62445bc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1593 microversion: 2.1 time: 0.171448 Jun 21 08:18:52.279993 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 299/537] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:52 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1593 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:52.583862 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1a71518e-b3ec-4829-93f2-1af6ce7f90f2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:52.584465 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1a71518e-b3ec-4829-93f2-1af6ce7f90f2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:52.592382 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1a71518e-b3ec-4829-93f2-1af6ce7f90f2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:52.592829 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1a71518e-b3ec-4829-93f2-1af6ce7f90f2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:52.593582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1a71518e-b3ec-4829-93f2-1af6ce7f90f2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:52.594011 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1a71518e-b3ec-4829-93f2-1af6ce7f90f2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:52.912556 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1a71518e-b3ec-4829-93f2-1af6ce7f90f2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:52.921675 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1a71518e-b3ec-4829-93f2-1af6ce7f90f2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 200 len: 1681 microversion: 2.1 time: 0.342208 Jun 21 08:18:52.922584 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 239/538] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:52 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 1681 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:53.315682 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-7c906fea-2ab0-4786-93fa-0b19cb9d2e4a req-6296e914-f311-4aaf-8df2-b020db5fd605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6909a083-0588-4b06-916a-e9b153960ffa", "name": "network-vif-deleted", "tag": "b38df0c4-4ff4-4131-becf-c141ab0b4a03"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:53.320140 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:53.327011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-7c906fea-2ab0-4786-93fa-0b19cb9d2e4a req-6296e914-f311-4aaf-8df2-b020db5fd605 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:53.327801 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-7c906fea-2ab0-4786-93fa-0b19cb9d2e4a req-6296e914-f311-4aaf-8df2-b020db5fd605 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:53.341557 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-7c906fea-2ab0-4786-93fa-0b19cb9d2e4a req-6296e914-f311-4aaf-8df2-b020db5fd605 service nova] Creating event network-vif-deleted:b38df0c4-4ff4-4131-becf-c141ab0b4a03 for instance 6909a083-0588-4b06-916a-e9b153960ffa on hv-cinder-83697 Jun 21 08:18:53.348078 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-7c906fea-2ab0-4786-93fa-0b19cb9d2e4a req-6296e914-f311-4aaf-8df2-b020db5fd605 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036004 Jun 21 08:18:53.349102 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 300/539] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:53.940327 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1679bc4d-28e5-4f81-9241-39911a79d720 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:53.940975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1679bc4d-28e5-4f81-9241-39911a79d720 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:53.956128 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1679bc4d-28e5-4f81-9241-39911a79d720 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:53.956584 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1679bc4d-28e5-4f81-9241-39911a79d720 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:53.958062 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1679bc4d-28e5-4f81-9241-39911a79d720 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:53.958498 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1679bc4d-28e5-4f81-9241-39911a79d720 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:53.977637 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-1679bc4d-28e5-4f81-9241-39911a79d720 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1679bc4d-28e5-4f81-9241-39911a79d720 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa HTTP/1.1 Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:18:53.979421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:18:53.981028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '6909a083-0588-4b06-916a-e9b153960ffa'} Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:18:53.981889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:18:53.983446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:18:53.986056 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1679bc4d-28e5-4f81-9241-39911a79d720 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:18:53.987646 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1679bc4d-28e5-4f81-9241-39911a79d720 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 404 len: 111 microversion: 2.1 time: 0.051589 Jun 21 08:18:53.994023 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 240/540] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:53 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:18:54.000723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6dab9522-1ff2-464f-8453-c91e2fa6f856 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '.version_select at 0x7fded821fe50>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:54.027438 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6dab9522-1ff2-464f-8453-c91e2fa6f856 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259946910" status: 202 len: 0 microversion: 2.1 time: 0.031330 Jun 21 08:18:54.028874 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 301/541] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 21 08:18:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259946910 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:18:54.692821 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-a9270897-e71d-452b-bc5d-3e6eb1e613d7 req-5b0d797c-985d-4391-933f-450924326062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32533add-63db-4d29-9be0-09f5ec2c39b3", "tag": "caad30cb-6338-4d28-a42e-d858cceaec6f"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:54.718429 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-a9270897-e71d-452b-bc5d-3e6eb1e613d7 req-5b0d797c-985d-4391-933f-450924326062 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:54.726432 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-a9270897-e71d-452b-bc5d-3e6eb1e613d7 req-5b0d797c-985d-4391-933f-450924326062 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:54.792350 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-a9270897-e71d-452b-bc5d-3e6eb1e613d7 req-5b0d797c-985d-4391-933f-450924326062 service nova] Creating event network-changed:caad30cb-6338-4d28-a42e-d858cceaec6f for instance 32533add-63db-4d29-9be0-09f5ec2c39b3 on hv-cinder-83697 Jun 21 08:18:54.800605 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-a9270897-e71d-452b-bc5d-3e6eb1e613d7 req-5b0d797c-985d-4391-933f-450924326062 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112182 Jun 21 08:18:54.802019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 241/542] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:55.793243 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-26c41a52-7eaa-4ce9-a6a5-4b23b1e17c54 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:55.793868 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-26c41a52-7eaa-4ce9-a6a5-4b23b1e17c54 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:55.802432 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-26c41a52-7eaa-4ce9-a6a5-4b23b1e17c54 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:55.803055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-26c41a52-7eaa-4ce9-a6a5-4b23b1e17c54 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:55.804056 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-26c41a52-7eaa-4ce9-a6a5-4b23b1e17c54 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:55.804504 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-26c41a52-7eaa-4ce9-a6a5-4b23b1e17c54 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:56.029653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-26c41a52-7eaa-4ce9-a6a5-4b23b1e17c54 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lazy-loading 'services' on Instance uuid 1c08d704-c754-4c7d-b0f4-540ebde6c782 {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:18:56.192703 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-26c41a52-7eaa-4ce9-a6a5-4b23b1e17c54 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-volume_attachments/088f3edb-b15c-4b00-aa78-c16fd4f16dca" status: 202 len: 0 microversion: 2.1 time: 0.404288 Jun 21 08:18:56.193453 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 302/543] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:18:55 2022] DELETE /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-volume_attachments/088f3edb-b15c-4b00-aa78-c16fd4f16dca => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:18:56.210920 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-38599785-f8f6-4b9e-9c32-7bad0a991328 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:56.214919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-38599785-f8f6-4b9e-9c32-7bad0a991328 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:56.232837 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-38599785-f8f6-4b9e-9c32-7bad0a991328 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:56.233984 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-38599785-f8f6-4b9e-9c32-7bad0a991328 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:56.235000 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-38599785-f8f6-4b9e-9c32-7bad0a991328 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:56.235759 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-38599785-f8f6-4b9e-9c32-7bad0a991328 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:56.283026 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-38599785-f8f6-4b9e-9c32-7bad0a991328 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085214 Jun 21 08:18:56.283764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 242/544] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:18:56 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:18:56.511289 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e7336b54-9f1c-4aee-b0a7-eb8838d4d1a6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1229667050"}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:56.512354 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e7336b54-9f1c-4aee-b0a7-eb8838d4d1a6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:56.527722 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7336b54-9f1c-4aee-b0a7-eb8838d4d1a6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:56.528328 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7336b54-9f1c-4aee-b0a7-eb8838d4d1a6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:56.529758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7336b54-9f1c-4aee-b0a7-eb8838d4d1a6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:56.535381 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7336b54-9f1c-4aee-b0a7-eb8838d4d1a6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:56.673541 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.network.security_group_api [None req-e7336b54-9f1c-4aee-b0a7-eb8838d4d1a6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Adding security group 1d683fec-9c28-456b-a13c-367c8821f678 to port caad30cb-6338-4d28-a42e-d858cceaec6f Jun 21 08:18:57.091598 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e7336b54-9f1c-4aee-b0a7-eb8838d4d1a6 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "POST /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/action" status: 202 len: 0 microversion: 2.1 time: 0.585680 Jun 21 08:18:57.095662 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 303/545] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:18:56 2022] POST /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 08:18:57.102676 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a02fa9ed-b712-4a2c-8abf-9fd528c99183 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:57.103890 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a02fa9ed-b712-4a2c-8abf-9fd528c99183 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:57.106506 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-28829fd5-9875-4b28-b28e-c46623a83176 req-4c1f041d-4cb2-40f3-a629-24f83d889a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32533add-63db-4d29-9be0-09f5ec2c39b3", "tag": "caad30cb-6338-4d28-a42e-d858cceaec6f"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:18:57.111235 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a02fa9ed-b712-4a2c-8abf-9fd528c99183 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:57.112041 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a02fa9ed-b712-4a2c-8abf-9fd528c99183 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:57.116813 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a02fa9ed-b712-4a2c-8abf-9fd528c99183 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:57.117508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a02fa9ed-b712-4a2c-8abf-9fd528c99183 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:57.135727 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-28829fd5-9875-4b28-b28e-c46623a83176 req-4c1f041d-4cb2-40f3-a629-24f83d889a79 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:57.136416 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-28829fd5-9875-4b28-b28e-c46623a83176 req-4c1f041d-4cb2-40f3-a629-24f83d889a79 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:57.152397 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-28829fd5-9875-4b28-b28e-c46623a83176 req-4c1f041d-4cb2-40f3-a629-24f83d889a79 service nova] Creating event network-changed:caad30cb-6338-4d28-a42e-d858cceaec6f for instance 32533add-63db-4d29-9be0-09f5ec2c39b3 on hv-cinder-83697 Jun 21 08:18:57.161077 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-28829fd5-9875-4b28-b28e-c46623a83176 req-4c1f041d-4cb2-40f3-a629-24f83d889a79 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060417 Jun 21 08:18:57.166349 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 304/546] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:18:57.296565 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b6ddd1c1-5e0e-486a-9365-dfbc096588d7 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:57.298605 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b6ddd1c1-5e0e-486a-9365-dfbc096588d7 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:57.308524 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6ddd1c1-5e0e-486a-9365-dfbc096588d7 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:57.309152 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6ddd1c1-5e0e-486a-9365-dfbc096588d7 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:57.310091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6ddd1c1-5e0e-486a-9365-dfbc096588d7 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:57.310725 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6ddd1c1-5e0e-486a-9365-dfbc096588d7 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:57.354235 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b6ddd1c1-5e0e-486a-9365-dfbc096588d7 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061845 Jun 21 08:18:57.355227 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 305/547] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:18:57 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:18:57.469048 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a02fa9ed-b712-4a2c-8abf-9fd528c99183 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:57.483217 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a02fa9ed-b712-4a2c-8abf-9fd528c99183 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1759 microversion: 2.1 time: 0.386492 Jun 21 08:18:57.483896 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 243/548] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:57 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1759 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:18:58.365927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b582083b-2a63-40c8-8a2d-344f12ee4690 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:58.366870 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b582083b-2a63-40c8-8a2d-344f12ee4690 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:58.373751 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b582083b-2a63-40c8-8a2d-344f12ee4690 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:58.374253 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b582083b-2a63-40c8-8a2d-344f12ee4690 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:58.375245 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b582083b-2a63-40c8-8a2d-344f12ee4690 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:58.376336 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b582083b-2a63-40c8-8a2d-344f12ee4690 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:58.407534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b582083b-2a63-40c8-8a2d-344f12ee4690 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045982 Jun 21 08:18:58.408081 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 306/549] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:18:58 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:18:58.469775 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-126ec388-b697-4588-b800-33c8515fd3f8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:58.470279 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-126ec388-b697-4588-b800-33c8515fd3f8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:58.478568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-126ec388-b697-4588-b800-33c8515fd3f8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:58.479072 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-126ec388-b697-4588-b800-33c8515fd3f8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:58.480019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-126ec388-b697-4588-b800-33c8515fd3f8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:58.480446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-126ec388-b697-4588-b800-33c8515fd3f8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:58.506852 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-126ec388-b697-4588-b800-33c8515fd3f8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:18:58.509902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:58.585476 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-126ec388-b697-4588-b800-33c8515fd3f8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 204 len: 0 microversion: 2.1 time: 0.118995 Jun 21 08:18:58.585772 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 244/550] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:18:58 2022] DELETE /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:18:58.594589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-86c10962-0bc8-4e6a-bdb2-2cbe59c1ebce tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:58.595395 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-86c10962-0bc8-4e6a-bdb2-2cbe59c1ebce tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:58.602806 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-86c10962-0bc8-4e6a-bdb2-2cbe59c1ebce tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:58.603568 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-86c10962-0bc8-4e6a-bdb2-2cbe59c1ebce tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:58.604437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-86c10962-0bc8-4e6a-bdb2-2cbe59c1ebce tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:58.604963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-86c10962-0bc8-4e6a-bdb2-2cbe59c1ebce tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:58.757722 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-86c10962-0bc8-4e6a-bdb2-2cbe59c1ebce tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:58.765334 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-86c10962-0bc8-4e6a-bdb2-2cbe59c1ebce tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1681 microversion: 2.1 time: 0.174824 Jun 21 08:18:58.765893 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 307/551] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:58 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:18:59.784550 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bd4dcbfe-5c05-468f-acee-075281593693 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:18:59.785252 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bd4dcbfe-5c05-468f-acee-075281593693 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:18:59.792401 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd4dcbfe-5c05-468f-acee-075281593693 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:59.792850 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd4dcbfe-5c05-468f-acee-075281593693 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:59.793614 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd4dcbfe-5c05-468f-acee-075281593693 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:18:59.794050 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd4dcbfe-5c05-468f-acee-075281593693 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:18:59.926590 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bd4dcbfe-5c05-468f-acee-075281593693 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:18:59.934837 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bd4dcbfe-5c05-468f-acee-075281593693 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1681 microversion: 2.1 time: 0.154476 Jun 21 08:18:59.935404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 245/552] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:18:59 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:00.952963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-85571a2d-d0d3-4481-ae2b-97e5ad0a0234 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:00.953501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-85571a2d-d0d3-4481-ae2b-97e5ad0a0234 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:00.959857 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85571a2d-d0d3-4481-ae2b-97e5ad0a0234 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:00.960310 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85571a2d-d0d3-4481-ae2b-97e5ad0a0234 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:00.961070 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85571a2d-d0d3-4481-ae2b-97e5ad0a0234 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:00.961503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85571a2d-d0d3-4481-ae2b-97e5ad0a0234 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:01.091545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-85571a2d-d0d3-4481-ae2b-97e5ad0a0234 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:01.101618 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-85571a2d-d0d3-4481-ae2b-97e5ad0a0234 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1681 microversion: 2.1 time: 0.152567 Jun 21 08:19:01.102187 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 308/553] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:00 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:01.864058 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-8711094d-51de-491a-a87e-a6366806f527 req-70c288b1-2d87-4d51-a9b0-3d66b6a51af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c08d704-c754-4c7d-b0f4-540ebde6c782", "name": "network-vif-deleted", "tag": "e7af3654-e669-4deb-a185-42a54ed5e149"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:01.875083 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-8711094d-51de-491a-a87e-a6366806f527 req-70c288b1-2d87-4d51-a9b0-3d66b6a51af6 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:01.875771 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-8711094d-51de-491a-a87e-a6366806f527 req-70c288b1-2d87-4d51-a9b0-3d66b6a51af6 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:01.888831 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-8711094d-51de-491a-a87e-a6366806f527 req-70c288b1-2d87-4d51-a9b0-3d66b6a51af6 service nova] Creating event network-vif-deleted:e7af3654-e669-4deb-a185-42a54ed5e149 for instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 on hv-cinder-83697 Jun 21 08:19:01.894965 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-8711094d-51de-491a-a87e-a6366806f527 req-70c288b1-2d87-4d51-a9b0-3d66b6a51af6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035199 Jun 21 08:19:01.895773 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 246/554] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:19:02.120271 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:02.120991 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:02.127495 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:02.127944 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:02.128703 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:02.129136 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:02.164770 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:02.165114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:02.165560 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lazy-loading 'fault' on Instance uuid 1c08d704-c754-4c7d-b0f4-540ebde6c782 {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:19:02.212199 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:02.219801 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ed8fefd4-70c6-44e0-a618-0f4219f5747d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 200 len: 1331 microversion: 2.1 time: 0.103527 Jun 21 08:19:02.220371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 309/555] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:02 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:02.665666 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-03d88d8d-0377-4db0-bac6-d74ba5bc7b05 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:02.666769 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-03d88d8d-0377-4db0-bac6-d74ba5bc7b05 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:02.673445 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-03d88d8d-0377-4db0-bac6-d74ba5bc7b05 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:02.673989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-03d88d8d-0377-4db0-bac6-d74ba5bc7b05 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:02.674802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-03d88d8d-0377-4db0-bac6-d74ba5bc7b05 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:02.675242 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-03d88d8d-0377-4db0-bac6-d74ba5bc7b05 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:02.753679 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-03d88d8d-0377-4db0-bac6-d74ba5bc7b05 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "POST /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/action" status: 202 len: 0 microversion: 2.1 time: 0.092950 Jun 21 08:19:02.757339 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 247/556] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:19:02 2022] POST /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:19:02.778902 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c1e32305-d78a-4850-a596-f0a86685e965 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:02.779670 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c1e32305-d78a-4850-a596-f0a86685e965 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:02.788887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c1e32305-d78a-4850-a596-f0a86685e965 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:02.789331 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c1e32305-d78a-4850-a596-f0a86685e965 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:02.790252 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c1e32305-d78a-4850-a596-f0a86685e965 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:02.790849 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c1e32305-d78a-4850-a596-f0a86685e965 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:02.978684 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c1e32305-d78a-4850-a596-f0a86685e965 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:02.986747 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c1e32305-d78a-4850-a596-f0a86685e965 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1751 microversion: 2.1 time: 0.226089 Jun 21 08:19:02.987514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 310/557] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:02 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1751 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:03.238413 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3d97cfbb-9f53-49db-9a76-78269090f2ca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:03.239329 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3d97cfbb-9f53-49db-9a76-78269090f2ca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:03.245708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3d97cfbb-9f53-49db-9a76-78269090f2ca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:03.246256 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3d97cfbb-9f53-49db-9a76-78269090f2ca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:03.247121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3d97cfbb-9f53-49db-9a76-78269090f2ca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:03.247554 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3d97cfbb-9f53-49db-9a76-78269090f2ca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:03.263919 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-3d97cfbb-9f53-49db-9a76-78269090f2ca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3d97cfbb-9f53-49db-9a76-78269090f2ca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 HTTP/1.1 Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:19:03.265568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:19:03.267209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '1c08d704-c754-4c7d-b0f4-540ebde6c782'} Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:19:03.268103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:19:03.269592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:19:03.271674 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3d97cfbb-9f53-49db-9a76-78269090f2ca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:19:03.271674 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3d97cfbb-9f53-49db-9a76-78269090f2ca tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 404 len: 111 microversion: 2.1 time: 0.033328 Jun 21 08:19:03.271674 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 248/558] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:03 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:19:03.276723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9f7ce0a6-d1c2-43ea-8e20-4b2a05afaac7 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '.version_select at 0x7fded8041160>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:03.295648 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9f7ce0a6-d1c2-43ea-8e20-4b2a05afaac7 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-375753112" status: 202 len: 0 microversion: 2.1 time: 0.022652 Jun 21 08:19:03.296210 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 311/559] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 21 08:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-375753112 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:19:03.947858 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4f0792b5-c89f-4a2a-907d-4737888f75c1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: .version_select at 0x7fded2e0d5e0>, body: {"keypair": {"name": "tempest-keypair-298292710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKrn5av6DAxB6GvaYut2ObPEKwbHt0Qdp3RV8k10iDJloT/Wv0pNDG5bfrdQ3krcnvudHpnRxTXyMiDkCtOSDKef5QXmeLFMtzNJdD/IZOwT7prCaW1k8WneH8VvzTH+Q=="}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:03.962956 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-4f0792b5-c89f-4a2a-907d-4737888f75c1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:19:03.966728 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-4f0792b5-c89f-4a2a-907d-4737888f75c1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for user de0dccd8f960443894a99baa79198005 and project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:19:03.988295 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4f0792b5-c89f-4a2a-907d-4737888f75c1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045428 Jun 21 08:19:03.992002 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 249/560] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 08:19:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:19:04.006069 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1ce4bf4b-0e13-4291-9c8e-3a953548868d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:04.006648 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1ce4bf4b-0e13-4291-9c8e-3a953548868d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:04.013218 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1ce4bf4b-0e13-4291-9c8e-3a953548868d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:04.013842 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1ce4bf4b-0e13-4291-9c8e-3a953548868d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:04.014610 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1ce4bf4b-0e13-4291-9c8e-3a953548868d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:04.015097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1ce4bf4b-0e13-4291-9c8e-3a953548868d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:04.233588 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1ce4bf4b-0e13-4291-9c8e-3a953548868d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:04.243678 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1ce4bf4b-0e13-4291-9c8e-3a953548868d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.242198 Jun 21 08:19:04.244631 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 312/561] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:03 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:05.261879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4117b2d5-186a-4df8-ae09-2b252ad172d9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:05.262515 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4117b2d5-186a-4df8-ae09-2b252ad172d9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:05.268963 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4117b2d5-186a-4df8-ae09-2b252ad172d9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:05.269174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4117b2d5-186a-4df8-ae09-2b252ad172d9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:05.270040 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4117b2d5-186a-4df8-ae09-2b252ad172d9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:05.274941 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4117b2d5-186a-4df8-ae09-2b252ad172d9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:05.413466 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-97169827", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbf78e3a-7b50-434f-bb05-1e295b095c9f"}], "security_groups": [{"name": "tempest-securitygroup--1953331653"}], "key_name": "tempest-keypair-298292710", "user_data": "}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:05.443322 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4117b2d5-186a-4df8-ae09-2b252ad172d9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:05.455717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4117b2d5-186a-4df8-ae09-2b252ad172d9 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.198244 Jun 21 08:19:05.456462 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 250/562] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:05 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:05.522920 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] validate_networks() for [('bbf78e3a-7b50-434f-bb05-1e295b095c9f', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:19:05.902418 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:19:05.902871 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:19:05.903339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:19:05.903750 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:19:05.904153 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:19:05.913110 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:05.913544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:05.914333 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:05.914790 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:05.933327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:19:05.937452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for user de0dccd8f960443894a99baa79198005 and project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:19:05.948932 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:19:05.951381 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:19:05.998350 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-41b0aebc-1255-41b2-bfb2-a46ee700f868 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.590458 Jun 21 08:19:05.999219 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 313/563] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:19:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 08:19:06.010741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fb8c3445-cb5b-4973-8de7-ad22a4b396a0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:06.011730 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-fb8c3445-cb5b-4973-8de7-ad22a4b396a0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:06.069101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fb8c3445-cb5b-4973-8de7-ad22a4b396a0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:06.076536 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fb8c3445-cb5b-4973-8de7-ad22a4b396a0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1239 microversion: 2.1 time: 0.070391 Jun 21 08:19:06.077158 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 251/564] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:06 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:06.473118 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3c5c6fb1-1d1a-4188-aa8a-5169584530fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:06.474244 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3c5c6fb1-1d1a-4188-aa8a-5169584530fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:06.480840 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3c5c6fb1-1d1a-4188-aa8a-5169584530fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:06.481287 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3c5c6fb1-1d1a-4188-aa8a-5169584530fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:06.482040 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3c5c6fb1-1d1a-4188-aa8a-5169584530fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:06.482467 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3c5c6fb1-1d1a-4188-aa8a-5169584530fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:06.636614 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-3c5c6fb1-1d1a-4188-aa8a-5169584530fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:06.644851 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3c5c6fb1-1d1a-4188-aa8a-5169584530fb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.175555 Jun 21 08:19:06.646787 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 314/565] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:06 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:07.096573 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6aad43b2-4f5f-4b90-af04-026280514f2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:07.107096 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6aad43b2-4f5f-4b90-af04-026280514f2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:07.113609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6aad43b2-4f5f-4b90-af04-026280514f2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:07.114132 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6aad43b2-4f5f-4b90-af04-026280514f2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:07.115560 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6aad43b2-4f5f-4b90-af04-026280514f2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:07.116010 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6aad43b2-4f5f-4b90-af04-026280514f2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:07.431700 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6aad43b2-4f5f-4b90-af04-026280514f2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:07.439541 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6aad43b2-4f5f-4b90-af04-026280514f2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1299 microversion: 2.1 time: 0.350032 Jun 21 08:19:07.446674 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 252/566] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:07 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1299 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:07.665259 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-828d4292-fbd5-4b6f-8e3e-259597af0286 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:07.665849 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-828d4292-fbd5-4b6f-8e3e-259597af0286 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:07.672381 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-828d4292-fbd5-4b6f-8e3e-259597af0286 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:07.672854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-828d4292-fbd5-4b6f-8e3e-259597af0286 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:07.673611 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-828d4292-fbd5-4b6f-8e3e-259597af0286 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:07.674040 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-828d4292-fbd5-4b6f-8e3e-259597af0286 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:07.833951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-828d4292-fbd5-4b6f-8e3e-259597af0286 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:07.842500 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-828d4292-fbd5-4b6f-8e3e-259597af0286 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.181141 Jun 21 08:19:07.843099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 315/567] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:07 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:08.457920 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2ce05bc6-1896-4334-94c7-e8a58d1de988 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:08.459551 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2ce05bc6-1896-4334-94c7-e8a58d1de988 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:08.462704 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:08.467249 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2ce05bc6-1896-4334-94c7-e8a58d1de988 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:08.467700 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2ce05bc6-1896-4334-94c7-e8a58d1de988 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:08.468479 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2ce05bc6-1896-4334-94c7-e8a58d1de988 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:08.468915 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2ce05bc6-1896-4334-94c7-e8a58d1de988 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:08.686016 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2ce05bc6-1896-4334-94c7-e8a58d1de988 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:08.695069 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2ce05bc6-1896-4334-94c7-e8a58d1de988 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1365 microversion: 2.1 time: 0.241159 Jun 21 08:19:08.695974 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 253/568] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:08 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:08.807797 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-dd8c1b6e-185d-4cf8-8c7a-da5ac4284423 req-75ac7fc6-f4f5-4513-a932-89f19dbaf2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74ee7b38-833c-4047-9999-c591d6088b45", "tag": "db282937-dba1-4afe-babe-818665f5c5a8"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:08.816739 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-dd8c1b6e-185d-4cf8-8c7a-da5ac4284423 req-75ac7fc6-f4f5-4513-a932-89f19dbaf2a8 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:08.817946 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-dd8c1b6e-185d-4cf8-8c7a-da5ac4284423 req-75ac7fc6-f4f5-4513-a932-89f19dbaf2a8 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:08.831299 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-dd8c1b6e-185d-4cf8-8c7a-da5ac4284423 req-75ac7fc6-f4f5-4513-a932-89f19dbaf2a8 service nova] Creating event network-changed:db282937-dba1-4afe-babe-818665f5c5a8 for instance 74ee7b38-833c-4047-9999-c591d6088b45 on hv-cinder-83697 Jun 21 08:19:08.837801 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-dd8c1b6e-185d-4cf8-8c7a-da5ac4284423 req-75ac7fc6-f4f5-4513-a932-89f19dbaf2a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033979 Jun 21 08:19:08.838390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 316/569] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:19:08.860352 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1e971ded-5399-49e7-808c-d35eff808bf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:08.861227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1e971ded-5399-49e7-808c-d35eff808bf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:08.868083 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1e971ded-5399-49e7-808c-d35eff808bf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:08.868528 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1e971ded-5399-49e7-808c-d35eff808bf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:08.869298 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1e971ded-5399-49e7-808c-d35eff808bf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:08.869728 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1e971ded-5399-49e7-808c-d35eff808bf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:09.127778 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1e971ded-5399-49e7-808c-d35eff808bf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:09.137382 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1e971ded-5399-49e7-808c-d35eff808bf4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.280828 Jun 21 08:19:09.137959 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 254/570] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:08 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:09.713731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-17c434a2-896a-4033-a36f-edc7ad055e6d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:09.714423 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-17c434a2-896a-4033-a36f-edc7ad055e6d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:09.720619 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17c434a2-896a-4033-a36f-edc7ad055e6d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:09.721062 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17c434a2-896a-4033-a36f-edc7ad055e6d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:09.721809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17c434a2-896a-4033-a36f-edc7ad055e6d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:09.722235 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-17c434a2-896a-4033-a36f-edc7ad055e6d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:09.856377 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-17c434a2-896a-4033-a36f-edc7ad055e6d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:09.863676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-17c434a2-896a-4033-a36f-edc7ad055e6d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1365 microversion: 2.1 time: 0.154209 Jun 21 08:19:09.864895 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 317/571] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:09 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:10.154829 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ecffef26-c6c1-4671-983a-3145a9878057 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:10.155345 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-ecffef26-c6c1-4671-983a-3145a9878057 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:10.162251 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ecffef26-c6c1-4671-983a-3145a9878057 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:10.162717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ecffef26-c6c1-4671-983a-3145a9878057 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:10.163578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ecffef26-c6c1-4671-983a-3145a9878057 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:10.164011 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ecffef26-c6c1-4671-983a-3145a9878057 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:10.306453 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-ecffef26-c6c1-4671-983a-3145a9878057 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:10.314396 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ecffef26-c6c1-4671-983a-3145a9878057 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.163455 Jun 21 08:19:10.314998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 255/572] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:10 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:10.882164 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-04601c6f-b3a3-4423-bbb9-24fd7eafff2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:10.882805 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-04601c6f-b3a3-4423-bbb9-24fd7eafff2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:10.888921 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04601c6f-b3a3-4423-bbb9-24fd7eafff2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:10.889362 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04601c6f-b3a3-4423-bbb9-24fd7eafff2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:10.890120 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04601c6f-b3a3-4423-bbb9-24fd7eafff2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:10.890545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04601c6f-b3a3-4423-bbb9-24fd7eafff2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:10.894875 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:11.028624 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-04601c6f-b3a3-4423-bbb9-24fd7eafff2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:11.035930 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-04601c6f-b3a3-4423-bbb9-24fd7eafff2c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1365 microversion: 2.1 time: 0.158259 Jun 21 08:19:11.036502 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 318/573] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:10 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:11.331416 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-910988a4-3955-48e9-9043-4be58ae42194 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:11.332022 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-910988a4-3955-48e9-9043-4be58ae42194 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:11.338579 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-910988a4-3955-48e9-9043-4be58ae42194 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:11.339053 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-910988a4-3955-48e9-9043-4be58ae42194 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:11.339800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-910988a4-3955-48e9-9043-4be58ae42194 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:11.340228 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-910988a4-3955-48e9-9043-4be58ae42194 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:11.480143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-910988a4-3955-48e9-9043-4be58ae42194 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:11.488006 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-910988a4-3955-48e9-9043-4be58ae42194 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.160372 Jun 21 08:19:11.488572 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 256/574] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:11 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:12.052739 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-77887aa4-242d-4eaf-bc31-91e50076efd1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:12.053353 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-77887aa4-242d-4eaf-bc31-91e50076efd1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:12.059345 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-77887aa4-242d-4eaf-bc31-91e50076efd1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:12.059794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-77887aa4-242d-4eaf-bc31-91e50076efd1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:12.060542 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-77887aa4-242d-4eaf-bc31-91e50076efd1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:12.060973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-77887aa4-242d-4eaf-bc31-91e50076efd1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:12.188247 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-77887aa4-242d-4eaf-bc31-91e50076efd1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:12.195944 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-77887aa4-242d-4eaf-bc31-91e50076efd1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1365 microversion: 2.1 time: 0.147125 Jun 21 08:19:12.196510 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 319/575] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:12 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:12.507458 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fddeb24a-b777-4749-9d99-b132be97c29a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:12.508277 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-fddeb24a-b777-4749-9d99-b132be97c29a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:12.517242 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fddeb24a-b777-4749-9d99-b132be97c29a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:12.517770 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fddeb24a-b777-4749-9d99-b132be97c29a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:12.518722 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fddeb24a-b777-4749-9d99-b132be97c29a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:12.519160 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fddeb24a-b777-4749-9d99-b132be97c29a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:12.673303 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fddeb24a-b777-4749-9d99-b132be97c29a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:12.683929 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fddeb24a-b777-4749-9d99-b132be97c29a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.181424 Jun 21 08:19:12.684513 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 257/576] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:12 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:13.212891 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-15a194a7-316e-496d-b3c9-e9e0f2e5b723 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:13.213499 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-15a194a7-316e-496d-b3c9-e9e0f2e5b723 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:13.219554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-15a194a7-316e-496d-b3c9-e9e0f2e5b723 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:13.219995 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-15a194a7-316e-496d-b3c9-e9e0f2e5b723 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:13.220742 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-15a194a7-316e-496d-b3c9-e9e0f2e5b723 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:13.221166 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-15a194a7-316e-496d-b3c9-e9e0f2e5b723 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:13.346403 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-15a194a7-316e-496d-b3c9-e9e0f2e5b723 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:13.354161 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-15a194a7-316e-496d-b3c9-e9e0f2e5b723 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1365 microversion: 2.1 time: 0.145139 Jun 21 08:19:13.354734 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 320/577] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:13 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:13.702387 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-19311370-9f67-4999-863b-3dd476ffc5ed tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:13.703419 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-19311370-9f67-4999-863b-3dd476ffc5ed tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:13.710236 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19311370-9f67-4999-863b-3dd476ffc5ed tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:13.710702 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19311370-9f67-4999-863b-3dd476ffc5ed tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:13.711459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19311370-9f67-4999-863b-3dd476ffc5ed tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:13.711963 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-19311370-9f67-4999-863b-3dd476ffc5ed tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:13.867694 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-19311370-9f67-4999-863b-3dd476ffc5ed tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:13.876055 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-19311370-9f67-4999-863b-3dd476ffc5ed tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.178412 Jun 21 08:19:13.876636 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 258/578] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:13 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:14.371391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e703fde2-afc8-42dc-8fca-25fd0c1cb623 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:14.372012 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e703fde2-afc8-42dc-8fca-25fd0c1cb623 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:14.378517 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e703fde2-afc8-42dc-8fca-25fd0c1cb623 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:14.378993 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e703fde2-afc8-42dc-8fca-25fd0c1cb623 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:14.380458 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e703fde2-afc8-42dc-8fca-25fd0c1cb623 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:14.380854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e703fde2-afc8-42dc-8fca-25fd0c1cb623 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:14.498842 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-d1c2db50-4a6f-4045-abd3-d7f7a7ae6f89 req-60b710ec-ae09-4301-b2ae-6d933107d613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74ee7b38-833c-4047-9999-c591d6088b45", "name": "network-vif-plugged", "status": "completed", "tag": "db282937-dba1-4afe-babe-818665f5c5a8"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:14.508894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-d1c2db50-4a6f-4045-abd3-d7f7a7ae6f89 req-60b710ec-ae09-4301-b2ae-6d933107d613 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:14.509622 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-d1c2db50-4a6f-4045-abd3-d7f7a7ae6f89 req-60b710ec-ae09-4301-b2ae-6d933107d613 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:14.512346 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e703fde2-afc8-42dc-8fca-25fd0c1cb623 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:14.521724 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e703fde2-afc8-42dc-8fca-25fd0c1cb623 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1365 microversion: 2.1 time: 0.154186 Jun 21 08:19:14.522305 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 321/579] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:14 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:14.523264 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-d1c2db50-4a6f-4045-abd3-d7f7a7ae6f89 req-60b710ec-ae09-4301-b2ae-6d933107d613 service nova] Creating event network-vif-plugged:db282937-dba1-4afe-babe-818665f5c5a8 for instance 74ee7b38-833c-4047-9999-c591d6088b45 on hv-cinder-83697 Jun 21 08:19:14.528282 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-d1c2db50-4a6f-4045-abd3-d7f7a7ae6f89 req-60b710ec-ae09-4301-b2ae-6d933107d613 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033172 Jun 21 08:19:14.529351 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 259/580] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:19:14.897254 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f2d6d198-22ae-4f7c-a2d8-7961b80e5e18 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:14.897883 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f2d6d198-22ae-4f7c-a2d8-7961b80e5e18 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:14.904144 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f2d6d198-22ae-4f7c-a2d8-7961b80e5e18 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:14.904597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f2d6d198-22ae-4f7c-a2d8-7961b80e5e18 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:14.905356 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f2d6d198-22ae-4f7c-a2d8-7961b80e5e18 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:14.905789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f2d6d198-22ae-4f7c-a2d8-7961b80e5e18 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:15.057838 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f2d6d198-22ae-4f7c-a2d8-7961b80e5e18 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:15.065718 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f2d6d198-22ae-4f7c-a2d8-7961b80e5e18 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.174832 Jun 21 08:19:15.066269 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 322/581] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:14 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:15.539366 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a2e1ac5f-c719-4e58-8b85-e83a699c222b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:15.540066 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a2e1ac5f-c719-4e58-8b85-e83a699c222b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:15.547183 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a2e1ac5f-c719-4e58-8b85-e83a699c222b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:15.547677 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a2e1ac5f-c719-4e58-8b85-e83a699c222b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:15.548390 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a2e1ac5f-c719-4e58-8b85-e83a699c222b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:15.548824 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a2e1ac5f-c719-4e58-8b85-e83a699c222b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:15.682785 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a2e1ac5f-c719-4e58-8b85-e83a699c222b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:15.690154 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a2e1ac5f-c719-4e58-8b85-e83a699c222b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1365 microversion: 2.1 time: 0.155105 Jun 21 08:19:15.690742 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 260/582] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:15 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:16.083172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-abe7fc72-1213-490b-8873-b34466746b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:16.084102 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-abe7fc72-1213-490b-8873-b34466746b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:16.085634 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:16.086440 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=6 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:16.092361 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-abe7fc72-1213-490b-8873-b34466746b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:16.092804 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-abe7fc72-1213-490b-8873-b34466746b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:16.093559 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-abe7fc72-1213-490b-8873-b34466746b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:16.093985 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-abe7fc72-1213-490b-8873-b34466746b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:16.248789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-abe7fc72-1213-490b-8873-b34466746b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:16.258018 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-abe7fc72-1213-490b-8873-b34466746b10 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.178902 Jun 21 08:19:16.258586 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 323/583] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:16 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:16.707170 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c551b1d2-8fbf-453e-9271-438e06c10eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:16.707775 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c551b1d2-8fbf-453e-9271-438e06c10eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:16.709796 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=6 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:16.715388 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c551b1d2-8fbf-453e-9271-438e06c10eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:16.715825 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c551b1d2-8fbf-453e-9271-438e06c10eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:16.716661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c551b1d2-8fbf-453e-9271-438e06c10eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:16.717085 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c551b1d2-8fbf-453e-9271-438e06c10eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:16.843058 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c551b1d2-8fbf-453e-9271-438e06c10eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:16.850906 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c551b1d2-8fbf-453e-9271-438e06c10eaa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1555 microversion: 2.1 time: 0.147103 Jun 21 08:19:16.851463 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 261/584] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:16 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:16.867123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-41033bfe-db8d-4374-abff-74bdfde17374 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:16.867632 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-41033bfe-db8d-4374-abff-74bdfde17374 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:16.873657 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41033bfe-db8d-4374-abff-74bdfde17374 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:16.874107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41033bfe-db8d-4374-abff-74bdfde17374 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:16.874907 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41033bfe-db8d-4374-abff-74bdfde17374 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:16.875344 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-41033bfe-db8d-4374-abff-74bdfde17374 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:16.951453 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-41033bfe-db8d-4374-abff-74bdfde17374 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088269 Jun 21 08:19:16.952047 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 324/585] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 08:19:16 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:19:17.276803 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0b12d78a-e664-4936-97c4-2888b0239295 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:17.277518 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0b12d78a-e664-4936-97c4-2888b0239295 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:17.284057 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0b12d78a-e664-4936-97c4-2888b0239295 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:17.284590 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0b12d78a-e664-4936-97c4-2888b0239295 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:17.286155 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0b12d78a-e664-4936-97c4-2888b0239295 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:17.286574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0b12d78a-e664-4936-97c4-2888b0239295 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:17.442538 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0b12d78a-e664-4936-97c4-2888b0239295 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:17.447692 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:17.453480 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0b12d78a-e664-4936-97c4-2888b0239295 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.181545 Jun 21 08:19:17.454144 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 262/586] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:17 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:17.892833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-327572ba-c7e4-40da-b6dc-225f00f0bb65 req-cf8cfcee-b50e-4764-9c92-559e089117ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74ee7b38-833c-4047-9999-c591d6088b45", "tag": "db282937-dba1-4afe-babe-818665f5c5a8"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:17.901891 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-327572ba-c7e4-40da-b6dc-225f00f0bb65 req-cf8cfcee-b50e-4764-9c92-559e089117ea service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:17.902334 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-327572ba-c7e4-40da-b6dc-225f00f0bb65 req-cf8cfcee-b50e-4764-9c92-559e089117ea service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:17.914044 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-327572ba-c7e4-40da-b6dc-225f00f0bb65 req-cf8cfcee-b50e-4764-9c92-559e089117ea service nova] Creating event network-changed:db282937-dba1-4afe-babe-818665f5c5a8 for instance 74ee7b38-833c-4047-9999-c591d6088b45 on hv-cinder-83697 Jun 21 08:19:17.919471 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-327572ba-c7e4-40da-b6dc-225f00f0bb65 req-cf8cfcee-b50e-4764-9c92-559e089117ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030372 Jun 21 08:19:17.920589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 325/587] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:19:18.471856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-711e6e0a-b9c8-4a79-9bae-333846c4a91e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:18.472681 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-711e6e0a-b9c8-4a79-9bae-333846c4a91e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:18.481117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-711e6e0a-b9c8-4a79-9bae-333846c4a91e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:18.481661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-711e6e0a-b9c8-4a79-9bae-333846c4a91e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:18.482755 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-711e6e0a-b9c8-4a79-9bae-333846c4a91e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:18.483275 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-711e6e0a-b9c8-4a79-9bae-333846c4a91e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:18.655964 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-711e6e0a-b9c8-4a79-9bae-333846c4a91e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:18.664309 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-711e6e0a-b9c8-4a79-9bae-333846c4a91e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.197138 Jun 21 08:19:18.674084 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 263/588] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:18 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:19.682870 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-74784df4-ceb2-4c79-aa82-2a24fe4687ec tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:19.684258 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-74784df4-ceb2-4c79-aa82-2a24fe4687ec tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:19.690853 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-74784df4-ceb2-4c79-aa82-2a24fe4687ec tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:19.691311 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-74784df4-ceb2-4c79-aa82-2a24fe4687ec tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:19.692075 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-74784df4-ceb2-4c79-aa82-2a24fe4687ec tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:19.692541 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-74784df4-ceb2-4c79-aa82-2a24fe4687ec tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:19.841340 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-74784df4-ceb2-4c79-aa82-2a24fe4687ec tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:19.851397 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-74784df4-ceb2-4c79-aa82-2a24fe4687ec tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.173081 Jun 21 08:19:19.852065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 326/589] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:19 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:20.869480 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-dc6f9424-a302-44f6-bd10-bbd175e4b96a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:20.870002 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-dc6f9424-a302-44f6-bd10-bbd175e4b96a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:20.876914 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc6f9424-a302-44f6-bd10-bbd175e4b96a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:20.877355 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc6f9424-a302-44f6-bd10-bbd175e4b96a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:20.878104 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc6f9424-a302-44f6-bd10-bbd175e4b96a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:20.878530 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc6f9424-a302-44f6-bd10-bbd175e4b96a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:21.024717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-dc6f9424-a302-44f6-bd10-bbd175e4b96a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:21.032709 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-dc6f9424-a302-44f6-bd10-bbd175e4b96a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.167747 Jun 21 08:19:21.033272 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 264/590] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:20 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:22.050896 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ccf9cd32-a55f-470e-b5e1-bf57392c899b tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:22.051512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ccf9cd32-a55f-470e-b5e1-bf57392c899b tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:22.057576 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ccf9cd32-a55f-470e-b5e1-bf57392c899b tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:22.058029 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ccf9cd32-a55f-470e-b5e1-bf57392c899b tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:22.058824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ccf9cd32-a55f-470e-b5e1-bf57392c899b tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:22.059255 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ccf9cd32-a55f-470e-b5e1-bf57392c899b tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:22.201704 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ccf9cd32-a55f-470e-b5e1-bf57392c899b tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:22.209560 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ccf9cd32-a55f-470e-b5e1-bf57392c899b tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.162587 Jun 21 08:19:22.210117 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 327/591] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:22 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:23.226943 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4ee562ac-1ef5-4f1d-889b-9de7051fc721 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:23.227579 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4ee562ac-1ef5-4f1d-889b-9de7051fc721 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:23.233870 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ee562ac-1ef5-4f1d-889b-9de7051fc721 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:23.234308 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ee562ac-1ef5-4f1d-889b-9de7051fc721 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:23.235093 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ee562ac-1ef5-4f1d-889b-9de7051fc721 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:23.235519 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ee562ac-1ef5-4f1d-889b-9de7051fc721 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:23.380094 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4ee562ac-1ef5-4f1d-889b-9de7051fc721 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:23.388539 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4ee562ac-1ef5-4f1d-889b-9de7051fc721 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.165400 Jun 21 08:19:23.389100 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 265/592] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:23 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:24.405305 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1513bcd1-5c15-41cb-bcf2-8323dc6e8ddb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:24.405945 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1513bcd1-5c15-41cb-bcf2-8323dc6e8ddb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:24.407977 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:24.413187 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1513bcd1-5c15-41cb-bcf2-8323dc6e8ddb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:24.413666 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1513bcd1-5c15-41cb-bcf2-8323dc6e8ddb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:24.414440 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1513bcd1-5c15-41cb-bcf2-8323dc6e8ddb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:24.415385 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1513bcd1-5c15-41cb-bcf2-8323dc6e8ddb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:24.579772 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1513bcd1-5c15-41cb-bcf2-8323dc6e8ddb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:24.588143 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1513bcd1-5c15-41cb-bcf2-8323dc6e8ddb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1756 microversion: 2.1 time: 0.186603 Jun 21 08:19:24.588712 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 328/593] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:24 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:25.604986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-865a8156-9e00-4515-98e5-01beb603ba7c tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:25.605611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-865a8156-9e00-4515-98e5-01beb603ba7c tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:25.611765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-865a8156-9e00-4515-98e5-01beb603ba7c tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:25.612208 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-865a8156-9e00-4515-98e5-01beb603ba7c tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:25.612955 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-865a8156-9e00-4515-98e5-01beb603ba7c tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:25.613384 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-865a8156-9e00-4515-98e5-01beb603ba7c tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:25.759066 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-865a8156-9e00-4515-98e5-01beb603ba7c tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:25.767375 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-865a8156-9e00-4515-98e5-01beb603ba7c tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1759 microversion: 2.1 time: 0.166274 Jun 21 08:19:25.768110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 266/594] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:25 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:32.394703 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c08f3c73-61c7-4ebd-a9ee-d6f65629e845 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6fabbd9-ef32-451e-a630-4d9c0866293c"}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:32.395963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c08f3c73-61c7-4ebd-a9ee-d6f65629e845 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:32.403981 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c08f3c73-61c7-4ebd-a9ee-d6f65629e845 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:32.404452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c08f3c73-61c7-4ebd-a9ee-d6f65629e845 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:32.405284 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c08f3c73-61c7-4ebd-a9ee-d6f65629e845 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:32.405803 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c08f3c73-61c7-4ebd-a9ee-d6f65629e845 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:32.947433 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c08f3c73-61c7-4ebd-a9ee-d6f65629e845 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557818 Jun 21 08:19:32.948052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 329/595] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:19:32 2022] POST /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments => generated 194 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:19:33.768126 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1c5a7c44-c6ca-4ee4-aa0e-818012ec29aa tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:33.768670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1c5a7c44-c6ca-4ee4-aa0e-818012ec29aa tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:33.775625 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1c5a7c44-c6ca-4ee4-aa0e-818012ec29aa tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:33.776077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1c5a7c44-c6ca-4ee4-aa0e-818012ec29aa tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:33.776844 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1c5a7c44-c6ca-4ee4-aa0e-818012ec29aa tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:33.777301 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1c5a7c44-c6ca-4ee4-aa0e-818012ec29aa tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:33.898726 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-1c5a7c44-c6ca-4ee4-aa0e-818012ec29aa tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lazy-loading 'services' on Instance uuid dfb2c496-4e45-441d-839c-09445870d85e {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:19:34.010957 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1c5a7c44-c6ca-4ee4-aa0e-818012ec29aa tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/os-volume_attachments/419e97b8-a520-4e3f-94b8-df3ea83e2596" status: 202 len: 0 microversion: 2.1 time: 0.246821 Jun 21 08:19:34.011583 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 267/596] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:19:33 2022] DELETE /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/os-volume_attachments/419e97b8-a520-4e3f-94b8-df3ea83e2596 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:19:40.481985 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d9d48e2e-af32-4218-8d2b-d2c6e7aa3b64 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:40.483103 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d9d48e2e-af32-4218-8d2b-d2c6e7aa3b64 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:40.489318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d9d48e2e-af32-4218-8d2b-d2c6e7aa3b64 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:40.489822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d9d48e2e-af32-4218-8d2b-d2c6e7aa3b64 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:40.490770 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d9d48e2e-af32-4218-8d2b-d2c6e7aa3b64 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:40.491209 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d9d48e2e-af32-4218-8d2b-d2c6e7aa3b64 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:40.514749 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-d9d48e2e-af32-4218-8d2b-d2c6e7aa3b64 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lazy-loading 'flavor' on Instance uuid 9636db4b-57b1-4e11-832b-584baecd8ed2 {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:19:40.657026 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d9d48e2e-af32-4218-8d2b-d2c6e7aa3b64 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/action" status: 200 len: 32 microversion: 2.1 time: 0.180824 Jun 21 08:19:40.657687 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 330/597] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:19:40 2022] POST /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:19:40.668089 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-42a337ee-7613-4d45-b04c-00a9c600c0bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:40.668788 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-42a337ee-7613-4d45-b04c-00a9c600c0bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:40.670748 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=30 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:40.677051 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42a337ee-7613-4d45-b04c-00a9c600c0bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:40.677783 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42a337ee-7613-4d45-b04c-00a9c600c0bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:40.678545 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42a337ee-7613-4d45-b04c-00a9c600c0bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:40.679031 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-42a337ee-7613-4d45-b04c-00a9c600c0bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:40.900017 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-42a337ee-7613-4d45-b04c-00a9c600c0bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:40.908175 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-42a337ee-7613-4d45-b04c-00a9c600c0bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.245132 Jun 21 08:19:40.908971 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 268/598] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:40 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:41.486872 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e4f4db7d-ecc5-478f-a0cb-10a75db45655 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:41.493084 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e4f4db7d-ecc5-478f-a0cb-10a75db45655 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:41.493531 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e4f4db7d-ecc5-478f-a0cb-10a75db45655 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:41.495812 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:41.517791 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e4f4db7d-ecc5-478f-a0cb-10a75db45655 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Going to try to stop instance {{(pid=117547) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 08:19:41.559387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e4f4db7d-ecc5-478f-a0cb-10a75db45655 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/action" status: 202 len: 0 microversion: 2.1 time: 0.077034 Jun 21 08:19:41.559972 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 331/599] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:19:41 2022] POST /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:19:41.568080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4225f4ff-f65d-418f-af9c-f3ca55ddbe50 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:41.569396 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4225f4ff-f65d-418f-af9c-f3ca55ddbe50 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:41.578015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4225f4ff-f65d-418f-af9c-f3ca55ddbe50 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:41.578462 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4225f4ff-f65d-418f-af9c-f3ca55ddbe50 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:41.579341 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4225f4ff-f65d-418f-af9c-f3ca55ddbe50 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:41.579793 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4225f4ff-f65d-418f-af9c-f3ca55ddbe50 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:41.718611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4225f4ff-f65d-418f-af9c-f3ca55ddbe50 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:41.726088 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4225f4ff-f65d-418f-af9c-f3ca55ddbe50 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1678 microversion: 2.1 time: 0.161849 Jun 21 08:19:41.726665 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 269/600] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:41 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:19:41.926482 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-acdee505-01c6-45fe-ab5e-349f3e3b2fa5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:41.927219 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-acdee505-01c6-45fe-ab5e-349f3e3b2fa5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:41.933987 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-acdee505-01c6-45fe-ab5e-349f3e3b2fa5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:41.934440 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-acdee505-01c6-45fe-ab5e-349f3e3b2fa5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:41.935246 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-acdee505-01c6-45fe-ab5e-349f3e3b2fa5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:41.935676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-acdee505-01c6-45fe-ab5e-349f3e3b2fa5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:42.293982 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-acdee505-01c6-45fe-ab5e-349f3e3b2fa5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:42.301899 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-acdee505-01c6-45fe-ab5e-349f3e3b2fa5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.379613 Jun 21 08:19:42.302465 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 332/601] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:41 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:42.743515 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2c6a89e7-b6e3-47e7-bec4-4eeb4dd466d4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:42.744114 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2c6a89e7-b6e3-47e7-bec4-4eeb4dd466d4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:42.750453 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2c6a89e7-b6e3-47e7-bec4-4eeb4dd466d4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:42.751192 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2c6a89e7-b6e3-47e7-bec4-4eeb4dd466d4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:42.751953 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2c6a89e7-b6e3-47e7-bec4-4eeb4dd466d4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:42.752387 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2c6a89e7-b6e3-47e7-bec4-4eeb4dd466d4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:43.126236 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2c6a89e7-b6e3-47e7-bec4-4eeb4dd466d4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:43.134128 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2c6a89e7-b6e3-47e7-bec4-4eeb4dd466d4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1678 microversion: 2.1 time: 0.394021 Jun 21 08:19:43.134788 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 270/602] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:42 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1678 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:43.319681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9b31975d-7ad3-4acf-84b2-c38adf89f0de tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:43.320313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9b31975d-7ad3-4acf-84b2-c38adf89f0de tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:43.327434 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9b31975d-7ad3-4acf-84b2-c38adf89f0de tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:43.327882 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9b31975d-7ad3-4acf-84b2-c38adf89f0de tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:43.328656 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9b31975d-7ad3-4acf-84b2-c38adf89f0de tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:43.329081 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9b31975d-7ad3-4acf-84b2-c38adf89f0de tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:43.459563 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9b31975d-7ad3-4acf-84b2-c38adf89f0de tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:43.467435 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9b31975d-7ad3-4acf-84b2-c38adf89f0de tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.151511 Jun 21 08:19:43.467988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 333/603] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:43 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:44.152201 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-54589ab0-78d3-450e-bf35-c5fed101c6d6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:44.152814 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-54589ab0-78d3-450e-bf35-c5fed101c6d6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:44.159397 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-54589ab0-78d3-450e-bf35-c5fed101c6d6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:44.159845 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-54589ab0-78d3-450e-bf35-c5fed101c6d6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:44.160592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-54589ab0-78d3-450e-bf35-c5fed101c6d6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:44.161024 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-54589ab0-78d3-450e-bf35-c5fed101c6d6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:44.287817 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-54589ab0-78d3-450e-bf35-c5fed101c6d6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:44.295777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-54589ab0-78d3-450e-bf35-c5fed101c6d6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1678 microversion: 2.1 time: 0.148400 Jun 21 08:19:44.296359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 271/604] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:44 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:44.483545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1b4eb8a8-da7d-4dde-b6df-d21e9b6e0b01 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:44.484151 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1b4eb8a8-da7d-4dde-b6df-d21e9b6e0b01 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:44.490558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1b4eb8a8-da7d-4dde-b6df-d21e9b6e0b01 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:44.490987 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1b4eb8a8-da7d-4dde-b6df-d21e9b6e0b01 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:44.491741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1b4eb8a8-da7d-4dde-b6df-d21e9b6e0b01 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:44.492173 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1b4eb8a8-da7d-4dde-b6df-d21e9b6e0b01 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:44.623353 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1b4eb8a8-da7d-4dde-b6df-d21e9b6e0b01 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:44.631389 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1b4eb8a8-da7d-4dde-b6df-d21e9b6e0b01 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.151681 Jun 21 08:19:44.631935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 334/605] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:44 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:45.312409 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1f817ea5-bbfe-4f99-9806-914caf25e9e5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:45.313030 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1f817ea5-bbfe-4f99-9806-914caf25e9e5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:45.319498 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1f817ea5-bbfe-4f99-9806-914caf25e9e5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:45.319972 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1f817ea5-bbfe-4f99-9806-914caf25e9e5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:45.320734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1f817ea5-bbfe-4f99-9806-914caf25e9e5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:45.321664 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1f817ea5-bbfe-4f99-9806-914caf25e9e5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:45.453615 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1f817ea5-bbfe-4f99-9806-914caf25e9e5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:45.461676 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1f817ea5-bbfe-4f99-9806-914caf25e9e5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1678 microversion: 2.1 time: 0.153126 Jun 21 08:19:45.462842 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 272/606] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:45 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:45.648853 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4633ead4-2310-4eeb-a3d7-187dba03c331 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:45.649935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4633ead4-2310-4eeb-a3d7-187dba03c331 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:45.656571 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4633ead4-2310-4eeb-a3d7-187dba03c331 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:45.657028 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4633ead4-2310-4eeb-a3d7-187dba03c331 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:45.657838 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4633ead4-2310-4eeb-a3d7-187dba03c331 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:45.658274 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4633ead4-2310-4eeb-a3d7-187dba03c331 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:45.784446 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4633ead4-2310-4eeb-a3d7-187dba03c331 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:45.792926 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4633ead4-2310-4eeb-a3d7-187dba03c331 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.147903 Jun 21 08:19:45.793483 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 335/607] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:45 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:46.479369 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c5e33f3c-1ebc-48c1-894c-c99771113b48 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:46.479981 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c5e33f3c-1ebc-48c1-894c-c99771113b48 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:46.486662 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5e33f3c-1ebc-48c1-894c-c99771113b48 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:46.487113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5e33f3c-1ebc-48c1-894c-c99771113b48 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:46.487912 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5e33f3c-1ebc-48c1-894c-c99771113b48 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:46.488520 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5e33f3c-1ebc-48c1-894c-c99771113b48 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:46.614196 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c5e33f3c-1ebc-48c1-894c-c99771113b48 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:46.622085 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c5e33f3c-1ebc-48c1-894c-c99771113b48 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1678 microversion: 2.1 time: 0.146620 Jun 21 08:19:46.622664 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 273/608] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:46 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:46.810851 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-099ab5b2-ea90-4993-80ce-04d927295bd4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:46.811404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-099ab5b2-ea90-4993-80ce-04d927295bd4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:46.817752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-099ab5b2-ea90-4993-80ce-04d927295bd4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:46.818196 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-099ab5b2-ea90-4993-80ce-04d927295bd4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:46.818979 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-099ab5b2-ea90-4993-80ce-04d927295bd4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:46.819408 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-099ab5b2-ea90-4993-80ce-04d927295bd4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:46.952984 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-099ab5b2-ea90-4993-80ce-04d927295bd4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:46.960787 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-099ab5b2-ea90-4993-80ce-04d927295bd4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.154045 Jun 21 08:19:46.961348 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 336/609] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:46 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:47.638790 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b8ebd029-0e4b-479b-ae65-31e8bcc5f13a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:47.639333 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b8ebd029-0e4b-479b-ae65-31e8bcc5f13a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:47.645715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b8ebd029-0e4b-479b-ae65-31e8bcc5f13a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:47.646161 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b8ebd029-0e4b-479b-ae65-31e8bcc5f13a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:47.646966 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b8ebd029-0e4b-479b-ae65-31e8bcc5f13a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:47.647382 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b8ebd029-0e4b-479b-ae65-31e8bcc5f13a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:47.778555 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b8ebd029-0e4b-479b-ae65-31e8bcc5f13a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:47.785985 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b8ebd029-0e4b-479b-ae65-31e8bcc5f13a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1678 microversion: 2.1 time: 0.151126 Jun 21 08:19:47.786546 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 274/610] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:47 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:47.979099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5276db36-60de-49db-8a36-7e12c8bcbd19 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:47.979706 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5276db36-60de-49db-8a36-7e12c8bcbd19 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:47.986114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5276db36-60de-49db-8a36-7e12c8bcbd19 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:47.986558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5276db36-60de-49db-8a36-7e12c8bcbd19 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:47.987336 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5276db36-60de-49db-8a36-7e12c8bcbd19 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:47.987769 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5276db36-60de-49db-8a36-7e12c8bcbd19 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:48.114664 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5276db36-60de-49db-8a36-7e12c8bcbd19 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:48.122647 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5276db36-60de-49db-8a36-7e12c8bcbd19 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.148043 Jun 21 08:19:48.123203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 337/611] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:47 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:48.802600 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-873a80e9-4952-4e47-89e8-594f2ade5d56 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:48.803234 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-873a80e9-4952-4e47-89e8-594f2ade5d56 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:48.810474 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-873a80e9-4952-4e47-89e8-594f2ade5d56 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:48.810942 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-873a80e9-4952-4e47-89e8-594f2ade5d56 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:48.811696 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-873a80e9-4952-4e47-89e8-594f2ade5d56 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:48.812121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-873a80e9-4952-4e47-89e8-594f2ade5d56 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:48.815943 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:48.939864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-873a80e9-4952-4e47-89e8-594f2ade5d56 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:48.948155 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-873a80e9-4952-4e47-89e8-594f2ade5d56 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1678 microversion: 2.1 time: 0.149562 Jun 21 08:19:48.948716 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 275/612] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:48 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:49.140355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-655f0d1f-d982-41f5-a1b0-99140c22ec6a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:49.140890 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-655f0d1f-d982-41f5-a1b0-99140c22ec6a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:49.147318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-655f0d1f-d982-41f5-a1b0-99140c22ec6a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:49.147764 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-655f0d1f-d982-41f5-a1b0-99140c22ec6a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:49.148519 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-655f0d1f-d982-41f5-a1b0-99140c22ec6a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:49.148951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-655f0d1f-d982-41f5-a1b0-99140c22ec6a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:49.273936 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-655f0d1f-d982-41f5-a1b0-99140c22ec6a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:49.281824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-655f0d1f-d982-41f5-a1b0-99140c22ec6a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.145356 Jun 21 08:19:49.282392 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 338/613] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:49 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:49.965959 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e5df9d9f-523a-4855-8e39-ac0362f96ec4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:49.966573 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e5df9d9f-523a-4855-8e39-ac0362f96ec4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:49.973119 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e5df9d9f-523a-4855-8e39-ac0362f96ec4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:49.973569 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e5df9d9f-523a-4855-8e39-ac0362f96ec4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:49.974328 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e5df9d9f-523a-4855-8e39-ac0362f96ec4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:49.974793 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e5df9d9f-523a-4855-8e39-ac0362f96ec4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:50.105845 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e5df9d9f-523a-4855-8e39-ac0362f96ec4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:50.113288 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e5df9d9f-523a-4855-8e39-ac0362f96ec4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1678 microversion: 2.1 time: 0.151966 Jun 21 08:19:50.113901 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 276/614] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:49 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:50.299294 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-2c867ff3-cd9d-42eb-ab64-2d980147d9cd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:50.299904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-2c867ff3-cd9d-42eb-ab64-2d980147d9cd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:50.307067 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2c867ff3-cd9d-42eb-ab64-2d980147d9cd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:50.307514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2c867ff3-cd9d-42eb-ab64-2d980147d9cd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:50.308277 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2c867ff3-cd9d-42eb-ab64-2d980147d9cd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:50.308714 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2c867ff3-cd9d-42eb-ab64-2d980147d9cd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:50.445027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2c867ff3-cd9d-42eb-ab64-2d980147d9cd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:50.453661 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-2c867ff3-cd9d-42eb-ab64-2d980147d9cd tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.158186 Jun 21 08:19:50.454226 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 339/615] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:50 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:51.131222 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8aaf5903-89ec-4cae-b484-03b5afaf7f61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:51.131834 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8aaf5903-89ec-4cae-b484-03b5afaf7f61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:51.138451 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8aaf5903-89ec-4cae-b484-03b5afaf7f61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:51.138931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8aaf5903-89ec-4cae-b484-03b5afaf7f61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:51.139694 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8aaf5903-89ec-4cae-b484-03b5afaf7f61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:51.140126 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8aaf5903-89ec-4cae-b484-03b5afaf7f61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:51.268921 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8aaf5903-89ec-4cae-b484-03b5afaf7f61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:51.277367 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8aaf5903-89ec-4cae-b484-03b5afaf7f61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1678 microversion: 2.1 time: 0.149989 Jun 21 08:19:51.277940 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 277/616] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:51 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:51.470975 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0dcaa066-5133-43b0-aced-d0c15de171a9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:51.471610 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0dcaa066-5133-43b0-aced-d0c15de171a9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:51.478144 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0dcaa066-5133-43b0-aced-d0c15de171a9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:51.478579 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0dcaa066-5133-43b0-aced-d0c15de171a9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:51.479357 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0dcaa066-5133-43b0-aced-d0c15de171a9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:51.479784 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0dcaa066-5133-43b0-aced-d0c15de171a9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:51.606523 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0dcaa066-5133-43b0-aced-d0c15de171a9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:51.614410 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0dcaa066-5133-43b0-aced-d0c15de171a9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.147400 Jun 21 08:19:51.615000 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 340/617] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:51 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:52.294670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-383ce52a-d504-4de3-bde5-be6f6ac7b1d1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:52.295255 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-383ce52a-d504-4de3-bde5-be6f6ac7b1d1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:52.301595 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-383ce52a-d504-4de3-bde5-be6f6ac7b1d1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:52.302036 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-383ce52a-d504-4de3-bde5-be6f6ac7b1d1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:52.302820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-383ce52a-d504-4de3-bde5-be6f6ac7b1d1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:52.303249 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-383ce52a-d504-4de3-bde5-be6f6ac7b1d1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:52.431676 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-383ce52a-d504-4de3-bde5-be6f6ac7b1d1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:52.439355 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-383ce52a-d504-4de3-bde5-be6f6ac7b1d1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1655 microversion: 2.1 time: 0.149132 Jun 21 08:19:52.439950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 278/618] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:52 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:52.456057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0b0f947d-7081-4ea7-bfb7-ec6bd5b6292c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:19:52.461948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0b0f947d-7081-4ea7-bfb7-ec6bd5b6292c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:52.462390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0b0f947d-7081-4ea7-bfb7-ec6bd5b6292c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:52.484521 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0b0f947d-7081-4ea7-bfb7-ec6bd5b6292c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Going to try to start instance {{(pid=117547) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 08:19:52.526065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0b0f947d-7081-4ea7-bfb7-ec6bd5b6292c tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/action" status: 202 len: 0 microversion: 2.1 time: 0.073626 Jun 21 08:19:52.526713 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 341/619] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:19:52 2022] POST /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:19:52.535511 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6237c604-f861-490d-afbb-0894b78d855d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:52.536152 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6237c604-f861-490d-afbb-0894b78d855d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:52.542658 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6237c604-f861-490d-afbb-0894b78d855d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:52.543170 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6237c604-f861-490d-afbb-0894b78d855d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:52.543938 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6237c604-f861-490d-afbb-0894b78d855d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:52.544499 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6237c604-f861-490d-afbb-0894b78d855d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:52.632950 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0c9b1a14-ad22-4f28-94dc-c37a26c402c1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:52.633646 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0c9b1a14-ad22-4f28-94dc-c37a26c402c1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:52.640596 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c9b1a14-ad22-4f28-94dc-c37a26c402c1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:52.641043 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c9b1a14-ad22-4f28-94dc-c37a26c402c1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:52.641792 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c9b1a14-ad22-4f28-94dc-c37a26c402c1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:52.642219 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c9b1a14-ad22-4f28-94dc-c37a26c402c1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:52.773668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6237c604-f861-490d-afbb-0894b78d855d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:52.775898 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0c9b1a14-ad22-4f28-94dc-c37a26c402c1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:52.782235 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6237c604-f861-490d-afbb-0894b78d855d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1664 microversion: 2.1 time: 0.250687 Jun 21 08:19:52.783054 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 279/620] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:52 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1664 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:52.786489 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0c9b1a14-ad22-4f28-94dc-c37a26c402c1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.157277 Jun 21 08:19:52.787167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 342/621] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:52 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:53.800081 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3fb16c57-fa13-4d73-81f5-ebc0ccdf3a75 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:53.800688 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3fb16c57-fa13-4d73-81f5-ebc0ccdf3a75 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:53.804386 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3428ff61-da66-472f-9c3c-ad2c079ad3bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:53.805024 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3428ff61-da66-472f-9c3c-ad2c079ad3bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:53.807495 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fb16c57-fa13-4d73-81f5-ebc0ccdf3a75 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:53.808168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fb16c57-fa13-4d73-81f5-ebc0ccdf3a75 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:53.808933 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fb16c57-fa13-4d73-81f5-ebc0ccdf3a75 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:53.809361 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fb16c57-fa13-4d73-81f5-ebc0ccdf3a75 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:53.812439 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3428ff61-da66-472f-9c3c-ad2c079ad3bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:53.812900 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3428ff61-da66-472f-9c3c-ad2c079ad3bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:53.813670 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3428ff61-da66-472f-9c3c-ad2c079ad3bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:53.814112 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3428ff61-da66-472f-9c3c-ad2c079ad3bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:53.939582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3fb16c57-fa13-4d73-81f5-ebc0ccdf3a75 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:53.945958 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-3428ff61-da66-472f-9c3c-ad2c079ad3bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:53.947538 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3fb16c57-fa13-4d73-81f5-ebc0ccdf3a75 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1664 microversion: 2.1 time: 0.151137 Jun 21 08:19:53.950661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 280/622] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:53 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:53.954490 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3428ff61-da66-472f-9c3c-ad2c079ad3bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.153977 Jun 21 08:19:53.955156 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 343/623] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:53 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:19:54.965280 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-63c2acbf-fc94-4f40-9cef-8ff15e3efeef tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:54.965881 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-63c2acbf-fc94-4f40-9cef-8ff15e3efeef tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:54.972066 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-06f070a2-963c-4902-a0b1-7557f9278075 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:54.972620 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-63c2acbf-fc94-4f40-9cef-8ff15e3efeef tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:54.972777 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-06f070a2-963c-4902-a0b1-7557f9278075 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:54.973075 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-63c2acbf-fc94-4f40-9cef-8ff15e3efeef tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:54.973848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-63c2acbf-fc94-4f40-9cef-8ff15e3efeef tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:54.974282 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-63c2acbf-fc94-4f40-9cef-8ff15e3efeef tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:54.975277 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=32 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:54.981667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-06f070a2-963c-4902-a0b1-7557f9278075 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:54.982099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-06f070a2-963c-4902-a0b1-7557f9278075 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:54.983069 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-06f070a2-963c-4902-a0b1-7557f9278075 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:54.983527 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-06f070a2-963c-4902-a0b1-7557f9278075 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:55.122405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-63c2acbf-fc94-4f40-9cef-8ff15e3efeef tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:55.123844 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-06f070a2-963c-4902-a0b1-7557f9278075 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:55.130228 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-63c2acbf-fc94-4f40-9cef-8ff15e3efeef tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1668 microversion: 2.1 time: 0.168885 Jun 21 08:19:55.130827 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 281/624] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:54 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:55.132360 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-06f070a2-963c-4902-a0b1-7557f9278075 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.164128 Jun 21 08:19:55.132996 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 344/625] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:54 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:19:56.149400 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-60840eb1-3334-4fe4-86aa-80e176331bc1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:56.150010 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-60840eb1-3334-4fe4-86aa-80e176331bc1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:56.156507 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60840eb1-3334-4fe4-86aa-80e176331bc1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:56.156954 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60840eb1-3334-4fe4-86aa-80e176331bc1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:56.157706 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60840eb1-3334-4fe4-86aa-80e176331bc1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:56.158134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60840eb1-3334-4fe4-86aa-80e176331bc1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:56.307590 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-60840eb1-3334-4fe4-86aa-80e176331bc1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:56.315651 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-60840eb1-3334-4fe4-86aa-80e176331bc1 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.170135 Jun 21 08:19:56.316225 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 282/626] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:56 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:57.332688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8cce6988-285f-4e4b-8749-da14b2c55385 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:57.333300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8cce6988-285f-4e4b-8749-da14b2c55385 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:57.340022 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8cce6988-285f-4e4b-8749-da14b2c55385 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:57.340473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8cce6988-285f-4e4b-8749-da14b2c55385 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:57.341230 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8cce6988-285f-4e4b-8749-da14b2c55385 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:57.341665 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8cce6988-285f-4e4b-8749-da14b2c55385 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:57.479665 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8cce6988-285f-4e4b-8749-da14b2c55385 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:57.481854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:57.488726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8cce6988-285f-4e4b-8749-da14b2c55385 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.159892 Jun 21 08:19:57.489282 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 345/627] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:57 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:58.507207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bcfc5c88-fd4d-4525-be23-01e6d62417f8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:58.507821 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bcfc5c88-fd4d-4525-be23-01e6d62417f8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:58.515297 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bcfc5c88-fd4d-4525-be23-01e6d62417f8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:58.515741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bcfc5c88-fd4d-4525-be23-01e6d62417f8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:58.516493 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bcfc5c88-fd4d-4525-be23-01e6d62417f8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:58.516945 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bcfc5c88-fd4d-4525-be23-01e6d62417f8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:58.644109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bcfc5c88-fd4d-4525-be23-01e6d62417f8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:58.652230 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bcfc5c88-fd4d-4525-be23-01e6d62417f8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1736 microversion: 2.1 time: 0.148885 Jun 21 08:19:58.652793 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 283/628] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:58 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:59.670608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-df6b0f16-42db-4fe1-81ea-37df7188e0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:59.671181 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-df6b0f16-42db-4fe1-81ea-37df7188e0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:59.678571 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-df6b0f16-42db-4fe1-81ea-37df7188e0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:59.679047 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-df6b0f16-42db-4fe1-81ea-37df7188e0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:59.679799 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-df6b0f16-42db-4fe1-81ea-37df7188e0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:59.680231 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-df6b0f16-42db-4fe1-81ea-37df7188e0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:59.809208 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-df6b0f16-42db-4fe1-81ea-37df7188e0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:19:59.817030 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-df6b0f16-42db-4fe1-81ea-37df7188e0c0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1716 microversion: 2.1 time: 0.151865 Jun 21 08:19:59.817599 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 346/629] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:19:59 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:19:59.919875 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0e6d7e1b-81a2-4d54-b0cd-1f577c728ff8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:19:59.920410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0e6d7e1b-81a2-4d54-b0cd-1f577c728ff8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:19:59.926818 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0e6d7e1b-81a2-4d54-b0cd-1f577c728ff8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:59.927199 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0e6d7e1b-81a2-4d54-b0cd-1f577c728ff8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:19:59.927947 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0e6d7e1b-81a2-4d54-b0cd-1f577c728ff8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:19:59.928374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0e6d7e1b-81a2-4d54-b0cd-1f577c728ff8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:00.007469 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-0e6d7e1b-81a2-4d54-b0cd-1f577c728ff8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] HTTP exception thrown: Cannot 'detach_volume' instance 9636db4b-57b1-4e11-832b-584baecd8ed2 while it is in vm_state rescued Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0e6d7e1b-81a2-4d54-b0cd-1f577c728ff8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Request method failure captured: Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: DELETE /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments/e6fabbd9-ef32-451e-a630-4d9c0866293c HTTP/1.1 Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4kw49eR-vbnBBhtDk_dfaC58ianxrNvQU-ghNVYEt5aSDOdJQr6rzlG7AbzaYFlP3Nx37QATSOBYxXOIuAPPLyANNgQF2TidMGs6Ceo68Tpl0m1pqj9Lyuaz61drO8mnz15JVyHEo6wXUzhlesQAyQT3WzfUYYe3uqvIbFIo_3ZzA Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 2001b029fae0472d8ef7b6fd658ad191 Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:20:00.009110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2001b029fae0472d8ef7b6fd658ad191", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 2001b029fae0472d8ef7b6fd658ad191 Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-ServerRescueNegativeTestJSON-1558605599-project Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 771f36afce0a4dd8897bb22f3c330856 Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1558605599-project Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:20:00.010843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Cannot 'detach_volume' instance 9636db4b-57b1-4e11-832b-584baecd8ed2 while it is in vm_state rescued Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'server_id': '9636db4b-57b1-4e11-832b-584baecd8ed2', 'id': 'e6fabbd9-ef32-451e-a630-4d9c0866293c'} Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9636db4b-57b1-4e11-832b-584baecd8ed2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:20:00.011729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9636db4b-57b1-4e11-832b-584baecd8ed2 while it is in vm_state rescued Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9636db4b-57b1-4e11-832b-584baecd8ed2 while it is in vm_state rescued Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:00.013257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0e6d7e1b-81a2-4d54-b0cd-1f577c728ff8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Returning 409 to user: Cannot 'detach_volume' instance 9636db4b-57b1-4e11-832b-584baecd8ed2 while it is in vm_state rescued {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:20:00.014474 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0e6d7e1b-81a2-4d54-b0cd-1f577c728ff8 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments/e6fabbd9-ef32-451e-a630-4d9c0866293c" status: 409 len: 152 microversion: 2.1 time: 0.095605 Jun 21 08:20:00.014474 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 284/630] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:19:59 2022] DELETE /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments/e6fabbd9-ef32-451e-a630-4d9c0866293c => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 08:20:00.019595 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9de3a227-2056-40e5-a3a3-93f68c94d451 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:00.020124 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9de3a227-2056-40e5-a3a3-93f68c94d451 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:00.027084 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9de3a227-2056-40e5-a3a3-93f68c94d451 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:00.027534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9de3a227-2056-40e5-a3a3-93f68c94d451 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:00.028290 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9de3a227-2056-40e5-a3a3-93f68c94d451 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:00.028722 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9de3a227-2056-40e5-a3a3-93f68c94d451 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:00.092854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9de3a227-2056-40e5-a3a3-93f68c94d451 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "POST /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/action" status: 202 len: 0 microversion: 2.1 time: 0.076818 Jun 21 08:20:00.093518 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 347/631] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:20:00 2022] POST /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:20:00.102452 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-521ff128-b6d4-458d-9cb5-85ef5b20ac4a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:00.103211 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-521ff128-b6d4-458d-9cb5-85ef5b20ac4a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:00.110056 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-521ff128-b6d4-458d-9cb5-85ef5b20ac4a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:00.110536 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-521ff128-b6d4-458d-9cb5-85ef5b20ac4a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:00.111416 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-521ff128-b6d4-458d-9cb5-85ef5b20ac4a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:00.111929 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-521ff128-b6d4-458d-9cb5-85ef5b20ac4a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:00.331758 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-521ff128-b6d4-458d-9cb5-85ef5b20ac4a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:00.340429 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-521ff128-b6d4-458d-9cb5-85ef5b20ac4a tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1724 microversion: 2.1 time: 0.242040 Jun 21 08:20:00.340989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 285/632] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:00 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:01.358386 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-709100dd-6253-469e-ba28-98c489b164fe tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:01.359097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-709100dd-6253-469e-ba28-98c489b164fe tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:01.365183 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-709100dd-6253-469e-ba28-98c489b164fe tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:01.365633 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-709100dd-6253-469e-ba28-98c489b164fe tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:01.366374 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-709100dd-6253-469e-ba28-98c489b164fe tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:01.366843 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-709100dd-6253-469e-ba28-98c489b164fe tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:01.498576 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-709100dd-6253-469e-ba28-98c489b164fe tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:01.506706 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-709100dd-6253-469e-ba28-98c489b164fe tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1724 microversion: 2.1 time: 0.153056 Jun 21 08:20:01.507262 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 348/633] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:01 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:01.632690 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3699d09e-0b83-4f15-9f01-ee99b523b58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:01.633152 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3699d09e-0b83-4f15-9f01-ee99b523b58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:01.640909 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3699d09e-0b83-4f15-9f01-ee99b523b58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:01.641357 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3699d09e-0b83-4f15-9f01-ee99b523b58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:01.642112 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3699d09e-0b83-4f15-9f01-ee99b523b58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:01.642545 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3699d09e-0b83-4f15-9f01-ee99b523b58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:01.665474 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3699d09e-0b83-4f15-9f01-ee99b523b58c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/ips" status: 200 len: 150 microversion: 2.1 time: 0.036727 Jun 21 08:20:01.667008 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 286/634] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 08:20:01 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:02.524703 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-841a4646-234c-466a-a752-6e99de9bdd92 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:02.525326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-841a4646-234c-466a-a752-6e99de9bdd92 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:02.532203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-841a4646-234c-466a-a752-6e99de9bdd92 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:02.532679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-841a4646-234c-466a-a752-6e99de9bdd92 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:02.533652 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-841a4646-234c-466a-a752-6e99de9bdd92 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:02.534096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-841a4646-234c-466a-a752-6e99de9bdd92 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:02.660669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-841a4646-234c-466a-a752-6e99de9bdd92 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:02.668672 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-841a4646-234c-466a-a752-6e99de9bdd92 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1730 microversion: 2.1 time: 0.147991 Jun 21 08:20:02.669237 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 349/635] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:02 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:02.684959 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-81fab09a-9d67-43f4-8f62-98cdae9722ab tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:02.685473 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-81fab09a-9d67-43f4-8f62-98cdae9722ab tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:02.691907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-81fab09a-9d67-43f4-8f62-98cdae9722ab tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:02.692359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-81fab09a-9d67-43f4-8f62-98cdae9722ab tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:02.693118 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-81fab09a-9d67-43f4-8f62-98cdae9722ab tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:02.693557 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-81fab09a-9d67-43f4-8f62-98cdae9722ab tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:02.775526 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-81fab09a-9d67-43f4-8f62-98cdae9722ab tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094285 Jun 21 08:20:02.776727 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 287/636] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 08:20:02 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:02.985633 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1d75a7a4-f7ed-42f5-bc11-66ab323975b6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ad9d759-ed0d-4d5d-a772-a5b3dee40f02"}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:02.986832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1d75a7a4-f7ed-42f5-bc11-66ab323975b6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:02.993027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1d75a7a4-f7ed-42f5-bc11-66ab323975b6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:02.993483 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1d75a7a4-f7ed-42f5-bc11-66ab323975b6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:02.994280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1d75a7a4-f7ed-42f5-bc11-66ab323975b6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:02.995260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1d75a7a4-f7ed-42f5-bc11-66ab323975b6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:03.238184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1d75a7a4-f7ed-42f5-bc11-66ab323975b6 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256437 Jun 21 08:20:03.239001 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 350/637] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:20:02 2022] POST /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:20:03.681909 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-e0a4ac48-acf9-44a2-ad99-5dd27238ecc7 req-d70f7412-6989-4f71-8734-1a3f84728dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9636db4b-57b1-4e11-832b-584baecd8ed2", "tag": "2cf35fad-280a-42ee-a53d-2d69eb288575"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:03.691896 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-e0a4ac48-acf9-44a2-ad99-5dd27238ecc7 req-d70f7412-6989-4f71-8734-1a3f84728dbc service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:03.693113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-e0a4ac48-acf9-44a2-ad99-5dd27238ecc7 req-d70f7412-6989-4f71-8734-1a3f84728dbc service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:03.706257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-e0a4ac48-acf9-44a2-ad99-5dd27238ecc7 req-d70f7412-6989-4f71-8734-1a3f84728dbc service nova] Creating event network-changed:2cf35fad-280a-42ee-a53d-2d69eb288575 for instance 9636db4b-57b1-4e11-832b-584baecd8ed2 on hv-cinder-83697 Jun 21 08:20:03.712055 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-e0a4ac48-acf9-44a2-ad99-5dd27238ecc7 req-d70f7412-6989-4f71-8734-1a3f84728dbc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034063 Jun 21 08:20:03.712852 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 288/638] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:05.727817 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-299312f1-964c-495d-a0ab-5316e3977199 req-82058d31-0d65-4896-af33-aa8faa72ecf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9636db4b-57b1-4e11-832b-584baecd8ed2", "tag": "2cf35fad-280a-42ee-a53d-2d69eb288575"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:05.736307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-299312f1-964c-495d-a0ab-5316e3977199 req-82058d31-0d65-4896-af33-aa8faa72ecf5 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:05.736756 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-299312f1-964c-495d-a0ab-5316e3977199 req-82058d31-0d65-4896-af33-aa8faa72ecf5 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:05.747551 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-299312f1-964c-495d-a0ab-5316e3977199 req-82058d31-0d65-4896-af33-aa8faa72ecf5 service nova] Creating event network-changed:2cf35fad-280a-42ee-a53d-2d69eb288575 for instance 9636db4b-57b1-4e11-832b-584baecd8ed2 on hv-cinder-83697 Jun 21 08:20:05.752606 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-299312f1-964c-495d-a0ab-5316e3977199 req-82058d31-0d65-4896-af33-aa8faa72ecf5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029343 Jun 21 08:20:05.753178 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 351/639] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:06.248326 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-dbb164c0-0ad2-412c-bc15-848bd737196e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1229667050"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:06.248879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-dbb164c0-0ad2-412c-bc15-848bd737196e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:06.255602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dbb164c0-0ad2-412c-bc15-848bd737196e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:06.256084 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dbb164c0-0ad2-412c-bc15-848bd737196e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:06.256851 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dbb164c0-0ad2-412c-bc15-848bd737196e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:06.257288 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dbb164c0-0ad2-412c-bc15-848bd737196e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:06.393935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.network.security_group_api [None req-dbb164c0-0ad2-412c-bc15-848bd737196e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Removing security group 1d683fec-9c28-456b-a13c-367c8821f678 from port caad30cb-6338-4d28-a42e-d858cceaec6f Jun 21 08:20:06.748446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-dbb164c0-0ad2-412c-bc15-848bd737196e tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "POST /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/action" status: 202 len: 0 microversion: 2.1 time: 0.505762 Jun 21 08:20:06.749081 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 289/640] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:20:06 2022] POST /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:20:07.785233 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-a973b131-64d6-45da-9310-ad4f63e0f0f3 req-db8de00d-4c4c-458f-87d1-b7d870170a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32533add-63db-4d29-9be0-09f5ec2c39b3", "tag": "caad30cb-6338-4d28-a42e-d858cceaec6f"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:07.795252 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-a973b131-64d6-45da-9310-ad4f63e0f0f3 req-db8de00d-4c4c-458f-87d1-b7d870170a62 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:07.795698 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-a973b131-64d6-45da-9310-ad4f63e0f0f3 req-db8de00d-4c4c-458f-87d1-b7d870170a62 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:07.806886 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-a973b131-64d6-45da-9310-ad4f63e0f0f3 req-db8de00d-4c4c-458f-87d1-b7d870170a62 service nova] Creating event network-changed:caad30cb-6338-4d28-a42e-d858cceaec6f for instance 32533add-63db-4d29-9be0-09f5ec2c39b3 on hv-cinder-83697 Jun 21 08:20:07.821976 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-a973b131-64d6-45da-9310-ad4f63e0f0f3 req-db8de00d-4c4c-458f-87d1-b7d870170a62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041500 Jun 21 08:20:07.822584 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 352/641] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:20:08.227685 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-463aef60-1eee-4ae9-8046-23994d458a92 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:08.228197 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-463aef60-1eee-4ae9-8046-23994d458a92 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:08.234259 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-463aef60-1eee-4ae9-8046-23994d458a92 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:08.234734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-463aef60-1eee-4ae9-8046-23994d458a92 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:08.235494 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-463aef60-1eee-4ae9-8046-23994d458a92 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:08.235922 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-463aef60-1eee-4ae9-8046-23994d458a92 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:08.319637 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-463aef60-1eee-4ae9-8046-23994d458a92 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lazy-loading 'services' on Instance uuid 32533add-63db-4d29-9be0-09f5ec2c39b3 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:20:08.400531 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-463aef60-1eee-4ae9-8046-23994d458a92 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "DELETE /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments/563a0226-e01c-46d9-b1d7-24fb8632e657" status: 202 len: 0 microversion: 2.1 time: 0.176811 Jun 21 08:20:08.402447 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 290/642] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:20:08 2022] DELETE /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments/563a0226-e01c-46d9-b1d7-24fb8632e657 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:20:08.414006 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f289ebe8-8be5-422f-92f8-8e9f5ff25bdc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:08.415219 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f289ebe8-8be5-422f-92f8-8e9f5ff25bdc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:08.425445 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f289ebe8-8be5-422f-92f8-8e9f5ff25bdc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:08.425912 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f289ebe8-8be5-422f-92f8-8e9f5ff25bdc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:08.427557 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f289ebe8-8be5-422f-92f8-8e9f5ff25bdc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:08.428454 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f289ebe8-8be5-422f-92f8-8e9f5ff25bdc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:08.463238 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f289ebe8-8be5-422f-92f8-8e9f5ff25bdc tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055737 Jun 21 08:20:08.464985 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 353/643] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:20:08 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:09.477286 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c1acb274-35f2-48c6-97ee-6ed81a60e0ff tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:09.478376 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c1acb274-35f2-48c6-97ee-6ed81a60e0ff tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:09.485146 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c1acb274-35f2-48c6-97ee-6ed81a60e0ff tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:09.485587 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c1acb274-35f2-48c6-97ee-6ed81a60e0ff tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:09.486335 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c1acb274-35f2-48c6-97ee-6ed81a60e0ff tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:09.486801 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c1acb274-35f2-48c6-97ee-6ed81a60e0ff tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:09.515614 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c1acb274-35f2-48c6-97ee-6ed81a60e0ff tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043166 Jun 21 08:20:09.516163 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 291/644] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:20:09 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:09.842967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-12ff8e02-a46c-4b80-abec-551fc0f0b8ba req-43e642d6-f26c-46de-9323-8773790ef328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32533add-63db-4d29-9be0-09f5ec2c39b3", "tag": "caad30cb-6338-4d28-a42e-d858cceaec6f"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:09.851306 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-12ff8e02-a46c-4b80-abec-551fc0f0b8ba req-43e642d6-f26c-46de-9323-8773790ef328 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:09.851745 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-12ff8e02-a46c-4b80-abec-551fc0f0b8ba req-43e642d6-f26c-46de-9323-8773790ef328 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:09.863190 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-12ff8e02-a46c-4b80-abec-551fc0f0b8ba req-43e642d6-f26c-46de-9323-8773790ef328 service nova] Creating event network-changed:caad30cb-6338-4d28-a42e-d858cceaec6f for instance 32533add-63db-4d29-9be0-09f5ec2c39b3 on hv-cinder-83697 Jun 21 08:20:09.867833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-12ff8e02-a46c-4b80-abec-551fc0f0b8ba req-43e642d6-f26c-46de-9323-8773790ef328 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029161 Jun 21 08:20:09.868392 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 354/645] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:10.527793 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-43527a78-7b69-4326-b632-17d299e1cd2f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:10.528733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-43527a78-7b69-4326-b632-17d299e1cd2f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:10.535400 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-43527a78-7b69-4326-b632-17d299e1cd2f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:10.535860 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-43527a78-7b69-4326-b632-17d299e1cd2f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:10.536615 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-43527a78-7b69-4326-b632-17d299e1cd2f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:10.537049 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-43527a78-7b69-4326-b632-17d299e1cd2f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:10.563131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:10.567629 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-43527a78-7b69-4326-b632-17d299e1cd2f tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044630 Jun 21 08:20:10.568192 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 292/646] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:20:10 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:20:10.578646 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-416f8b14-f4ed-4c98-b454-be156c7da82a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:10.579231 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-416f8b14-f4ed-4c98-b454-be156c7da82a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:10.585579 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-416f8b14-f4ed-4c98-b454-be156c7da82a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:10.586020 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-416f8b14-f4ed-4c98-b454-be156c7da82a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:10.586794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-416f8b14-f4ed-4c98-b454-be156c7da82a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:10.587226 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-416f8b14-f4ed-4c98-b454-be156c7da82a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:10.663951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-416f8b14-f4ed-4c98-b454-be156c7da82a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] HTTP exception thrown: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 is not attached to volume 563a0226-e01c-46d9-b1d7-24fb8632e657 Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-416f8b14-f4ed-4c98-b454-be156c7da82a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Request method failure captured: Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: DELETE /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments/563a0226-e01c-46d9-b1d7-24fb8632e657 HTTP/1.1 Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX6MPQeh4DHElbEFB7ZbbQGiJgr8leYXxqr2ONVTMeJPIkp7qSRMacPrlmBxCHMI659hDecvc-WUt_cbzRv8QNmTBfs36tSrmqRIDt_wtedVVe5-NRrjD6EtsegrFcR9WRu0_AXpzh7cwTvN7e_aGLhmWf7Sl_z39UavrtAghsdoygY Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 054a41c637b243f180a79969432bb3f8 Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-TestMinimumBasicScenario-58408600 Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:20:10.666315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/054a41c637b243f180a79969432bb3f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/054a41c637b243f180a79969432bb3f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/054a41c637b243f180a79969432bb3f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_054a41c637b243f180a79969432bb3f8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-TestMinimumBasicScenario-58408600 Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 054a41c637b243f180a79969432bb3f8 Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-TestMinimumBasicScenario-58408600 Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-TestMinimumBasicScenario-58408600-project Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 0143621344994e29b232c9e35c25d427 Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-TestMinimumBasicScenario-58408600-project Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:20:10.667783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 is not attached to volume 563a0226-e01c-46d9-b1d7-24fb8632e657 Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'server_id': '32533add-63db-4d29-9be0-09f5ec2c39b3', 'id': '563a0226-e01c-46d9-b1d7-24fb8632e657'} Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 563a0226-e01c-46d9-b1d7-24fb8632e657. Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:20:10.668498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 is not attached to volume 563a0226-e01c-46d9-b1d7-24fb8632e657 Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 is not attached to volume 563a0226-e01c-46d9-b1d7-24fb8632e657 Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:10.669667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-416f8b14-f4ed-4c98-b454-be156c7da82a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Returning 404 to user: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 is not attached to volume 563a0226-e01c-46d9-b1d7-24fb8632e657 {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:20:10.670808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-416f8b14-f4ed-4c98-b454-be156c7da82a tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "DELETE /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments/563a0226-e01c-46d9-b1d7-24fb8632e657" status: 404 len: 154 microversion: 2.1 time: 0.093521 Jun 21 08:20:10.670808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 355/647] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:20:10 2022] DELETE /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3/os-volume_attachments/563a0226-e01c-46d9-b1d7-24fb8632e657 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:20:10.754251 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-55de0a59-0745-440c-a7d1-3adb580d30d4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ad9d759-ed0d-4d5d-a772-a5b3dee40f02"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:10.755358 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-55de0a59-0745-440c-a7d1-3adb580d30d4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:10.757125 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=50 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:10.764513 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-55de0a59-0745-440c-a7d1-3adb580d30d4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:10.765119 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-55de0a59-0745-440c-a7d1-3adb580d30d4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:10.766284 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-55de0a59-0745-440c-a7d1-3adb580d30d4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:10.767113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-55de0a59-0745-440c-a7d1-3adb580d30d4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:10.848088 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-55de0a59-0745-440c-a7d1-3adb580d30d4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Invalid volume: volume 2ad9d759-ed0d-4d5d-a772-a5b3dee40f02 is already attached to instances: 74ee7b38-833c-4047-9999-c591d6088b45 Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-55de0a59-0745-440c-a7d1-3adb580d30d4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: POST /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments HTTP/1.1 Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 74 Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:20:10.849877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {"volumeAttachment": {"volumeId": "2ad9d759-ed0d-4d5d-a772-a5b3dee40f02"}} Jun 21 08:20:10.851459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Invalid volume: volume 2ad9d759-ed0d-4d5d-a772-a5b3dee40f02 is already attached to instances: 74ee7b38-833c-4047-9999-c591d6088b45 Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'server_id': '74ee7b38-833c-4047-9999-c591d6088b45', 'body': {'volumeAttachment': {'volumeId': '2ad9d759-ed0d-4d5d-a772-a5b3dee40f02'}}} Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2ad9d759-ed0d-4d5d-a772-a5b3dee40f02 is already attached to instances: 74ee7b38-833c-4047-9999-c591d6088b45 Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:10.852359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2ad9d759-ed0d-4d5d-a772-a5b3dee40f02 is already attached to instances: 74ee7b38-833c-4047-9999-c591d6088b45 Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:10.853715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:10.855340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:10.855340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:20:10.855340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:20:10.855340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2ad9d759-ed0d-4d5d-a772-a5b3dee40f02 is already attached to instances: 74ee7b38-833c-4047-9999-c591d6088b45 Jun 21 08:20:10.855340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:10.855340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-55de0a59-0745-440c-a7d1-3adb580d30d4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 400 to user: Invalid volume: volume 2ad9d759-ed0d-4d5d-a772-a5b3dee40f02 is already attached to instances: 74ee7b38-833c-4047-9999-c591d6088b45 {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:20:10.855340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-55de0a59-0745-440c-a7d1-3adb580d30d4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102025 Jun 21 08:20:10.855340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 293/648] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:20:10 2022] POST /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 08:20:10.914127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0736a4e4-b1dc-4b44-b086-1d5bd2f768b4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:10.914603 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0736a4e4-b1dc-4b44-b086-1d5bd2f768b4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:10.921570 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0736a4e4-b1dc-4b44-b086-1d5bd2f768b4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:10.922017 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0736a4e4-b1dc-4b44-b086-1d5bd2f768b4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:10.922818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0736a4e4-b1dc-4b44-b086-1d5bd2f768b4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:10.923252 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0736a4e4-b1dc-4b44-b086-1d5bd2f768b4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:11.005824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-0736a4e4-b1dc-4b44-b086-1d5bd2f768b4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lazy-loading 'services' on Instance uuid 74ee7b38-833c-4047-9999-c591d6088b45 {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:20:11.086561 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0736a4e4-b1dc-4b44-b086-1d5bd2f768b4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments/2ad9d759-ed0d-4d5d-a772-a5b3dee40f02" status: 202 len: 0 microversion: 2.1 time: 0.176161 Jun 21 08:20:11.087186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 356/649] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:20:10 2022] DELETE /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments/2ad9d759-ed0d-4d5d-a772-a5b3dee40f02 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:20:11.095620 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-13ed4beb-6d30-4086-9823-cab9d0599238 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:11.096554 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-13ed4beb-6d30-4086-9823-cab9d0599238 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:11.102753 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-13ed4beb-6d30-4086-9823-cab9d0599238 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:11.104797 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-13ed4beb-6d30-4086-9823-cab9d0599238 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:11.104797 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-13ed4beb-6d30-4086-9823-cab9d0599238 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:11.105029 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-13ed4beb-6d30-4086-9823-cab9d0599238 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:11.137314 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-13ed4beb-6d30-4086-9823-cab9d0599238 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045720 Jun 21 08:20:11.137864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 294/650] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:20:11 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:11.814827 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8a77ae74-fc1c-4a9f-9fd1-8728b484cdbb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:11.815415 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8a77ae74-fc1c-4a9f-9fd1-8728b484cdbb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:11.821708 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8a77ae74-fc1c-4a9f-9fd1-8728b484cdbb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:11.822114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8a77ae74-fc1c-4a9f-9fd1-8728b484cdbb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:11.823724 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8a77ae74-fc1c-4a9f-9fd1-8728b484cdbb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:11.824270 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8a77ae74-fc1c-4a9f-9fd1-8728b484cdbb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:11.848487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8a77ae74-fc1c-4a9f-9fd1-8728b484cdbb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Going to try to terminate instance {{(pid=117547) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:20:11.926600 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8a77ae74-fc1c-4a9f-9fd1-8728b484cdbb tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "DELETE /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 204 len: 0 microversion: 2.1 time: 0.115763 Jun 21 08:20:11.927469 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 357/651] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:20:11 2022] DELETE /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:20:11.936049 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-38939029-ad18-4652-a591-a25b897bb937 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:11.936680 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-38939029-ad18-4652-a591-a25b897bb937 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:11.943178 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-38939029-ad18-4652-a591-a25b897bb937 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:11.943629 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-38939029-ad18-4652-a591-a25b897bb937 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:11.944393 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-38939029-ad18-4652-a591-a25b897bb937 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:11.944830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-38939029-ad18-4652-a591-a25b897bb937 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:12.077649 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-38939029-ad18-4652-a591-a25b897bb937 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:12.085142 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-38939029-ad18-4652-a591-a25b897bb937 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1553 microversion: 2.1 time: 0.153237 Jun 21 08:20:12.085709 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 295/652] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:11 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:12.149431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a55c4931-0f0e-4896-b980-804bf257656f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:12.150524 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a55c4931-0f0e-4896-b980-804bf257656f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:12.157163 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a55c4931-0f0e-4896-b980-804bf257656f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:12.157605 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a55c4931-0f0e-4896-b980-804bf257656f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:12.158352 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a55c4931-0f0e-4896-b980-804bf257656f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:12.158820 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a55c4931-0f0e-4896-b980-804bf257656f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:12.186915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a55c4931-0f0e-4896-b980-804bf257656f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041675 Jun 21 08:20:12.187464 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 358/653] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:20:12 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:20:12.243110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bcf805e6-0089-41f3-a104-370461d0949c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:12.243608 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bcf805e6-0089-41f3-a104-370461d0949c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:12.249536 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bcf805e6-0089-41f3-a104-370461d0949c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:12.249980 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bcf805e6-0089-41f3-a104-370461d0949c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:12.250766 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bcf805e6-0089-41f3-a104-370461d0949c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:12.251198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bcf805e6-0089-41f3-a104-370461d0949c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:12.275710 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bcf805e6-0089-41f3-a104-370461d0949c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:20:12.347222 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bcf805e6-0089-41f3-a104-370461d0949c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 204 len: 0 microversion: 2.1 time: 0.107559 Jun 21 08:20:12.347716 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 296/654] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:20:12 2022] DELETE /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:20:12.355910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7aae634b-20e8-4b79-aaea-4e880a47ec36 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:12.356531 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7aae634b-20e8-4b79-aaea-4e880a47ec36 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:12.362574 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7aae634b-20e8-4b79-aaea-4e880a47ec36 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:12.363058 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7aae634b-20e8-4b79-aaea-4e880a47ec36 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:12.363818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7aae634b-20e8-4b79-aaea-4e880a47ec36 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:12.364258 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7aae634b-20e8-4b79-aaea-4e880a47ec36 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:12.491933 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7aae634b-20e8-4b79-aaea-4e880a47ec36 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:12.494245 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:12.502055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7aae634b-20e8-4b79-aaea-4e880a47ec36 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1680 microversion: 2.1 time: 0.150038 Jun 21 08:20:12.502612 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 359/655] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:12 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:13.103493 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7304bf45-650d-41e9-97cf-703a328d56e4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:13.104297 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-7304bf45-650d-41e9-97cf-703a328d56e4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:13.110792 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7304bf45-650d-41e9-97cf-703a328d56e4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:13.111236 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7304bf45-650d-41e9-97cf-703a328d56e4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:13.111984 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7304bf45-650d-41e9-97cf-703a328d56e4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:13.112413 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7304bf45-650d-41e9-97cf-703a328d56e4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:13.239080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-7304bf45-650d-41e9-97cf-703a328d56e4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:13.247077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7304bf45-650d-41e9-97cf-703a328d56e4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1553 microversion: 2.1 time: 0.147785 Jun 21 08:20:13.247640 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 297/656] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:13 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:13.519723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-880e2780-494d-46eb-92e0-550f03a33a0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:13.520337 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-880e2780-494d-46eb-92e0-550f03a33a0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:13.527597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-880e2780-494d-46eb-92e0-550f03a33a0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:13.528050 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-880e2780-494d-46eb-92e0-550f03a33a0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:13.528798 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-880e2780-494d-46eb-92e0-550f03a33a0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:13.529229 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-880e2780-494d-46eb-92e0-550f03a33a0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:13.655722 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-880e2780-494d-46eb-92e0-550f03a33a0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:13.663058 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-880e2780-494d-46eb-92e0-550f03a33a0f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1680 microversion: 2.1 time: 0.147470 Jun 21 08:20:13.663617 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 360/657] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:13 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:14.264289 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a045ad51-b898-457c-bf26-8d16081de84d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:14.264814 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a045ad51-b898-457c-bf26-8d16081de84d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:14.271221 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a045ad51-b898-457c-bf26-8d16081de84d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:14.271661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a045ad51-b898-457c-bf26-8d16081de84d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:14.272409 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a045ad51-b898-457c-bf26-8d16081de84d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:14.272835 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a045ad51-b898-457c-bf26-8d16081de84d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:14.406573 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a045ad51-b898-457c-bf26-8d16081de84d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:14.414114 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a045ad51-b898-457c-bf26-8d16081de84d tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1553 microversion: 2.1 time: 0.153750 Jun 21 08:20:14.414685 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 298/658] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:14 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:14.681537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4669b906-5af4-4ab0-9a1b-40dc197e72bb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:14.682586 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4669b906-5af4-4ab0-9a1b-40dc197e72bb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:14.689047 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4669b906-5af4-4ab0-9a1b-40dc197e72bb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:14.689495 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4669b906-5af4-4ab0-9a1b-40dc197e72bb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:14.690245 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4669b906-5af4-4ab0-9a1b-40dc197e72bb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:14.690701 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4669b906-5af4-4ab0-9a1b-40dc197e72bb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:14.822460 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4669b906-5af4-4ab0-9a1b-40dc197e72bb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:14.830450 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4669b906-5af4-4ab0-9a1b-40dc197e72bb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1680 microversion: 2.1 time: 0.152884 Jun 21 08:20:14.831031 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 361/659] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:14 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:15.431536 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5e2ae26d-7457-4042-9a72-2a5e0d49bce4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:15.432805 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5e2ae26d-7457-4042-9a72-2a5e0d49bce4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:15.439231 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5e2ae26d-7457-4042-9a72-2a5e0d49bce4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:15.439672 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5e2ae26d-7457-4042-9a72-2a5e0d49bce4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:15.440422 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5e2ae26d-7457-4042-9a72-2a5e0d49bce4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:15.440853 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5e2ae26d-7457-4042-9a72-2a5e0d49bce4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:15.847428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-2d24ebe3-4732-4d00-b95b-3724d071edbb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:15.848184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-2d24ebe3-4732-4d00-b95b-3724d071edbb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:15.855758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2d24ebe3-4732-4d00-b95b-3724d071edbb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:15.856318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2d24ebe3-4732-4d00-b95b-3724d071edbb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:15.857310 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2d24ebe3-4732-4d00-b95b-3724d071edbb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:15.857807 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2d24ebe3-4732-4d00-b95b-3724d071edbb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:16.005882 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5e2ae26d-7457-4042-9a72-2a5e0d49bce4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0143621344994e29b232c9e35c25d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a41c637b243f180a79969432bb3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:16.007098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2d24ebe3-4732-4d00-b95b-3724d071edbb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:16.015356 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5e2ae26d-7457-4042-9a72-2a5e0d49bce4 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 200 len: 1553 microversion: 2.1 time: 0.587975 Jun 21 08:20:16.017253 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 299/660] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:15 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 1553 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:16.018279 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-2d24ebe3-4732-4d00-b95b-3724d071edbb tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1680 microversion: 2.1 time: 0.174564 Jun 21 08:20:16.022372 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-716f8eae-9aec-4017-a117-d2bce4f94638 req-b7aa2776-865d-46fa-86a2-4df34dad9dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32533add-63db-4d29-9be0-09f5ec2c39b3", "name": "network-vif-deleted", "tag": "caad30cb-6338-4d28-a42e-d858cceaec6f"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:16.028601 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 362/661] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:15 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:16.031626 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-716f8eae-9aec-4017-a117-d2bce4f94638 req-b7aa2776-865d-46fa-86a2-4df34dad9dd6 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:16.032334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-716f8eae-9aec-4017-a117-d2bce4f94638 req-b7aa2776-865d-46fa-86a2-4df34dad9dd6 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:16.045010 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-716f8eae-9aec-4017-a117-d2bce4f94638 req-b7aa2776-865d-46fa-86a2-4df34dad9dd6 service nova] Creating event network-vif-deleted:caad30cb-6338-4d28-a42e-d858cceaec6f for instance 32533add-63db-4d29-9be0-09f5ec2c39b3 on hv-cinder-83697 Jun 21 08:20:16.050224 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-716f8eae-9aec-4017-a117-d2bce4f94638 req-b7aa2776-865d-46fa-86a2-4df34dad9dd6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031574 Jun 21 08:20:16.051015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 300/662] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:17.034655 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dfab1473-d9c0-45d1-8539-f2cbd18730df tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:17.035984 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-dfab1473-d9c0-45d1-8539-f2cbd18730df tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] [instance: 32533add-63db-4d29-9be0-09f5ec2c39b3] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:17.043137 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:17.044292 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:17.044731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dfab1473-d9c0-45d1-8539-f2cbd18730df tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:17.045467 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dfab1473-d9c0-45d1-8539-f2cbd18730df tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:17.046832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dfab1473-d9c0-45d1-8539-f2cbd18730df tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:17.047895 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dfab1473-d9c0-45d1-8539-f2cbd18730df tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:17.051874 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:17.052330 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:17.054005 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:17.054128 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:17.065019 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-dfab1473-d9c0-45d1-8539-f2cbd18730df tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] HTTP exception thrown: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 could not be found. Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dfab1473-d9c0-45d1-8539-f2cbd18730df tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Request method failure captured: Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 HTTP/1.1 Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX6MPQeh4DHElbEFB7ZbbQGiJgr8leYXxqr2ONVTMeJPIkp7qSRMacPrlmBxCHMI659hDecvc-WUt_cbzRv8QNmTBfs36tSrmqRIDt_wtedVVe5-NRrjD6EtsegrFcR9WRu0_AXpzh7cwTvN7e_aGLhmWf7Sl_z39UavrtAghsdoygY Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 054a41c637b243f180a79969432bb3f8 Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-TestMinimumBasicScenario-58408600 Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:20:17.066904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/054a41c637b243f180a79969432bb3f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/054a41c637b243f180a79969432bb3f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/054a41c637b243f180a79969432bb3f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_054a41c637b243f180a79969432bb3f8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-TestMinimumBasicScenario-58408600 Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 054a41c637b243f180a79969432bb3f8 Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-TestMinimumBasicScenario-58408600 Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-TestMinimumBasicScenario-58408600-project Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 0143621344994e29b232c9e35c25d427 Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-TestMinimumBasicScenario-58408600-project Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 could not be found. Jun 21 08:20:17.068296 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '32533add-63db-4d29-9be0-09f5ec2c39b3'} Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 could not be found. Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:20:17.069025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 could not be found. Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 could not be found. Jun 21 08:20:17.070184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:17.072517 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dfab1473-d9c0-45d1-8539-f2cbd18730df tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Returning 404 to user: Instance 32533add-63db-4d29-9be0-09f5ec2c39b3 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:20:17.073584 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-dfab1473-d9c0-45d1-8539-f2cbd18730df tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3" status: 404 len: 111 microversion: 2.1 time: 0.044067 Jun 21 08:20:17.077829 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 363/663] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:17 2022] GET /compute/v2.1/servers/32533add-63db-4d29-9be0-09f5ec2c39b3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:20:17.082400 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b5652e54-dbe7-444c-97cd-fac0dc62dbf3 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] Calling method '.version_select at 0x7fded8041ca0>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:17.089093 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:17.089580 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:17.090169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lazy-loading 'fault' on Instance uuid 74ee7b38-833c-4047-9999-c591d6088b45 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:20:17.103294 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b5652e54-dbe7-444c-97cd-fac0dc62dbf3 tempest-TestMinimumBasicScenario-58408600 tempest-TestMinimumBasicScenario-58408600-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-815556871" status: 202 len: 0 microversion: 2.1 time: 0.024481 Jun 21 08:20:17.106385 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 364/664] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Jun 21 08:20:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-815556871 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:20:17.140807 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:17.149035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8536d93a-de63-4088-b7c9-34011a06b31d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 200 len: 1329 microversion: 2.1 time: 0.115525 Jun 21 08:20:17.160314 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 301/665] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:17 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 1329 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:18.076787 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-13f9adac-839f-446e-b6b6-265ffabd80f7 req-18a7c6b5-3e6f-432f-b122-33c40952a0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74ee7b38-833c-4047-9999-c591d6088b45", "name": "network-vif-deleted", "tag": "db282937-dba1-4afe-babe-818665f5c5a8"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:18.085535 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-13f9adac-839f-446e-b6b6-265ffabd80f7 req-18a7c6b5-3e6f-432f-b122-33c40952a0f3 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:18.085980 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-13f9adac-839f-446e-b6b6-265ffabd80f7 req-18a7c6b5-3e6f-432f-b122-33c40952a0f3 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:18.097244 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-13f9adac-839f-446e-b6b6-265ffabd80f7 req-18a7c6b5-3e6f-432f-b122-33c40952a0f3 service nova] Creating event network-vif-deleted:db282937-dba1-4afe-babe-818665f5c5a8 for instance 74ee7b38-833c-4047-9999-c591d6088b45 on hv-cinder-83697 Jun 21 08:20:18.102066 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-13f9adac-839f-446e-b6b6-265ffabd80f7 req-18a7c6b5-3e6f-432f-b122-33c40952a0f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030201 Jun 21 08:20:18.102680 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 365/666] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:18.167347 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8644176f-49f0-47cc-bae8-6a9a5e0e499e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:18.167941 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8644176f-49f0-47cc-bae8-6a9a5e0e499e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:18.174877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8644176f-49f0-47cc-bae8-6a9a5e0e499e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:18.175323 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8644176f-49f0-47cc-bae8-6a9a5e0e499e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:18.176089 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8644176f-49f0-47cc-bae8-6a9a5e0e499e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:18.176519 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8644176f-49f0-47cc-bae8-6a9a5e0e499e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:18.189632 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-8644176f-49f0-47cc-bae8-6a9a5e0e499e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8644176f-49f0-47cc-bae8-6a9a5e0e499e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 HTTP/1.1 Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:20:18.191373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:20:18.192880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '74ee7b38-833c-4047-9999-c591d6088b45'} Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:20:18.193670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:20:18.194999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:18.196059 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8644176f-49f0-47cc-bae8-6a9a5e0e499e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:20:18.196059 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8644176f-49f0-47cc-bae8-6a9a5e0e499e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 404 len: 111 microversion: 2.1 time: 0.030019 Jun 21 08:20:18.196059 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 302/667] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:18 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:20:18.203024 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0c620e6e-2b22-4209-852d-f4d85464dc99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '.version_select at 0x7fded8041790>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:18.220709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0c620e6e-2b22-4209-852d-f4d85464dc99 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-298292710" status: 202 len: 0 microversion: 2.1 time: 0.022018 Jun 21 08:20:18.221272 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 366/668] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 21 08:20:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-298292710 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:20:18.884490 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9a46f425-35f1-48f7-9560-3f5edf96bbf4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: .version_select at 0x7fded2cea1f0>, body: {"keypair": {"name": "tempest-keypair-1292803965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo0bBOMPOV79ze8YsPjQKVxYVqn306XLR2TzKXnV2hLnAS9RskP95dcNLgRJ2CnNgyOeQ6MVbHKME5yCWgMF+RDgi1m+NsSlmJ+iKD6ekBPeeoWXlTSeb7vpzz7fd27nw=="}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:18.899827 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-9a46f425-35f1-48f7-9560-3f5edf96bbf4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:20:18.905225 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-9a46f425-35f1-48f7-9560-3f5edf96bbf4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for user de0dccd8f960443894a99baa79198005 and project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:20:18.936215 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9a46f425-35f1-48f7-9560-3f5edf96bbf4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055700 Jun 21 08:20:18.941718 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 303/669] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 08:20:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:20.422770 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2098668949", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbf78e3a-7b50-434f-bb05-1e295b095c9f"}], "security_groups": [{"name": "tempest-securitygroup--1930425811"}], "key_name": "tempest-keypair-1292803965", "user_data": "}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:20.674985 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] validate_networks() for [('bbf78e3a-7b50-434f-bb05-1e295b095c9f', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:20:21.347732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:20:21.348148 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:20:21.348614 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:20:21.349018 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:20:21.349427 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:20:21.358779 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:21.359220 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:21.360007 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:21.360435 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:21.377695 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:20:21.381695 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Getting quotas for user de0dccd8f960443894a99baa79198005 and project d1a4467fae7e4bdea5a1e00c0379c326. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:20:21.392812 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:20:21.395185 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:20:21.442315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4d49a134-a46e-4f1c-b0e1-89c618f9baf8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.032376 Jun 21 08:20:21.446765 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 367/670] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:20:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:20:21.453892 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-51e503b0-9506-4d2f-ad7b-c414e658d6ea tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:21.454511 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-51e503b0-9506-4d2f-ad7b-c414e658d6ea tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:21.562430 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-51e503b0-9506-4d2f-ad7b-c414e658d6ea tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:21.577299 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-51e503b0-9506-4d2f-ad7b-c414e658d6ea tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1242 microversion: 2.1 time: 0.127649 Jun 21 08:20:21.577878 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 304/671] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:21 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:22.593648 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6990935c-176d-47d6-96dd-60e2887b4743 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:22.594300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6990935c-176d-47d6-96dd-60e2887b4743 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:22.601368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6990935c-176d-47d6-96dd-60e2887b4743 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:22.601831 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6990935c-176d-47d6-96dd-60e2887b4743 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:22.602607 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6990935c-176d-47d6-96dd-60e2887b4743 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:22.603070 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6990935c-176d-47d6-96dd-60e2887b4743 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:22.667956 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-6990935c-176d-47d6-96dd-60e2887b4743 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:22.675536 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6990935c-176d-47d6-96dd-60e2887b4743 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1300 microversion: 2.1 time: 0.085918 Jun 21 08:20:22.676098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 368/672] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:22 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:23.693260 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-17beeb71-f324-42cc-b12c-cab097d7e82c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:23.693949 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-17beeb71-f324-42cc-b12c-cab097d7e82c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:23.701019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-17beeb71-f324-42cc-b12c-cab097d7e82c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:23.701459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-17beeb71-f324-42cc-b12c-cab097d7e82c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:23.702213 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-17beeb71-f324-42cc-b12c-cab097d7e82c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:23.702683 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-17beeb71-f324-42cc-b12c-cab097d7e82c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:24.107423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-17beeb71-f324-42cc-b12c-cab097d7e82c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:24.118601 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-17beeb71-f324-42cc-b12c-cab097d7e82c tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1368 microversion: 2.1 time: 0.429004 Jun 21 08:20:24.129089 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 305/673] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:23 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1368 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:24.806134 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-90b1c432-61db-4d2c-a785-93855d1323fc req-a97eb0f8-4986-4c88-a6b1-fbb455694f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed508fef-cc9b-42c9-b954-0e52c65a1d12", "tag": "d6dff98b-1192-424a-9a7e-a012cd149f34"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:24.829319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-90b1c432-61db-4d2c-a785-93855d1323fc req-a97eb0f8-4986-4c88-a6b1-fbb455694f47 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:24.830028 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-90b1c432-61db-4d2c-a785-93855d1323fc req-a97eb0f8-4986-4c88-a6b1-fbb455694f47 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:24.860799 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-90b1c432-61db-4d2c-a785-93855d1323fc req-a97eb0f8-4986-4c88-a6b1-fbb455694f47 service nova] Creating event network-changed:d6dff98b-1192-424a-9a7e-a012cd149f34 for instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 on hv-cinder-83697 Jun 21 08:20:24.876796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-90b1c432-61db-4d2c-a785-93855d1323fc req-a97eb0f8-4986-4c88-a6b1-fbb455694f47 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074065 Jun 21 08:20:24.878157 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 369/674] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:25.136553 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-73bb7746-10cc-4f57-b589-cd8cc5fc8de8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:25.137176 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-73bb7746-10cc-4f57-b589-cd8cc5fc8de8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:25.144930 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-73bb7746-10cc-4f57-b589-cd8cc5fc8de8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:25.145589 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-73bb7746-10cc-4f57-b589-cd8cc5fc8de8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:25.146578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-73bb7746-10cc-4f57-b589-cd8cc5fc8de8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:25.147371 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-73bb7746-10cc-4f57-b589-cd8cc5fc8de8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:25.399532 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-73bb7746-10cc-4f57-b589-cd8cc5fc8de8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:25.408189 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-73bb7746-10cc-4f57-b589-cd8cc5fc8de8 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1368 microversion: 2.1 time: 0.276188 Jun 21 08:20:25.408754 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 306/675] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:25 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:26.430427 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fa84f3bb-c913-43e3-8349-f3bfba9bc94d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:26.431072 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fa84f3bb-c913-43e3-8349-f3bfba9bc94d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:26.433278 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:26.438737 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fa84f3bb-c913-43e3-8349-f3bfba9bc94d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:26.439188 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fa84f3bb-c913-43e3-8349-f3bfba9bc94d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:26.439955 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fa84f3bb-c913-43e3-8349-f3bfba9bc94d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:26.440388 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fa84f3bb-c913-43e3-8349-f3bfba9bc94d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:26.582875 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fa84f3bb-c913-43e3-8349-f3bfba9bc94d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:26.590936 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fa84f3bb-c913-43e3-8349-f3bfba9bc94d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1368 microversion: 2.1 time: 0.165252 Jun 21 08:20:26.591508 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 370/676] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:26 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:27.828035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-704fcaa5-000d-462d-9afb-f583ce1fe88b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:27.834851 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-704fcaa5-000d-462d-9afb-f583ce1fe88b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:27.841641 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-704fcaa5-000d-462d-9afb-f583ce1fe88b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:27.842079 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-704fcaa5-000d-462d-9afb-f583ce1fe88b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:27.842858 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-704fcaa5-000d-462d-9afb-f583ce1fe88b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:27.843286 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-704fcaa5-000d-462d-9afb-f583ce1fe88b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:27.968936 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-704fcaa5-000d-462d-9afb-f583ce1fe88b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:27.976317 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-704fcaa5-000d-462d-9afb-f583ce1fe88b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1368 microversion: 2.1 time: 0.372415 Jun 21 08:20:27.976878 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 307/677] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:27 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1368 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:28.993487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-95c37ec7-ecee-4986-8133-fe379f8b2117 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:28.994752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-95c37ec7-ecee-4986-8133-fe379f8b2117 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:29.001318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-95c37ec7-ecee-4986-8133-fe379f8b2117 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:29.002057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-95c37ec7-ecee-4986-8133-fe379f8b2117 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:29.002847 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-95c37ec7-ecee-4986-8133-fe379f8b2117 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:29.003283 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-95c37ec7-ecee-4986-8133-fe379f8b2117 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:29.135679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-95c37ec7-ecee-4986-8133-fe379f8b2117 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:29.143162 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-95c37ec7-ecee-4986-8133-fe379f8b2117 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1368 microversion: 2.1 time: 0.153725 Jun 21 08:20:29.143834 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 371/678] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:28 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:30.161282 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b5b5af5d-a0ce-421b-8613-c3fdeedb68c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:30.161811 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b5b5af5d-a0ce-421b-8613-c3fdeedb68c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:30.169018 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b5b5af5d-a0ce-421b-8613-c3fdeedb68c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:30.169456 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b5b5af5d-a0ce-421b-8613-c3fdeedb68c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:30.170204 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b5b5af5d-a0ce-421b-8613-c3fdeedb68c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:30.170638 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b5b5af5d-a0ce-421b-8613-c3fdeedb68c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:30.298819 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b5b5af5d-a0ce-421b-8613-c3fdeedb68c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:30.306068 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b5b5af5d-a0ce-421b-8613-c3fdeedb68c2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1368 microversion: 2.1 time: 0.148723 Jun 21 08:20:30.307606 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 308/679] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:30 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:30.896349 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-4e014f92-89ce-41a8-931d-1a6381105d40 req-3fb71223-03aa-47fb-b11c-c4672e343141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed508fef-cc9b-42c9-b954-0e52c65a1d12", "name": "network-vif-plugged", "status": "completed", "tag": "d6dff98b-1192-424a-9a7e-a012cd149f34"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:30.905436 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-4e014f92-89ce-41a8-931d-1a6381105d40 req-3fb71223-03aa-47fb-b11c-c4672e343141 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:30.906094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-4e014f92-89ce-41a8-931d-1a6381105d40 req-3fb71223-03aa-47fb-b11c-c4672e343141 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:30.917233 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-4e014f92-89ce-41a8-931d-1a6381105d40 req-3fb71223-03aa-47fb-b11c-c4672e343141 service nova] Creating event network-vif-plugged:d6dff98b-1192-424a-9a7e-a012cd149f34 for instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 on hv-cinder-83697 Jun 21 08:20:30.922175 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-4e014f92-89ce-41a8-931d-1a6381105d40 req-3fb71223-03aa-47fb-b11c-c4672e343141 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029516 Jun 21 08:20:30.922755 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 372/680] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:31.323894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d1be1642-f3ac-45cb-b297-6c7ff2484236 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:31.324542 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d1be1642-f3ac-45cb-b297-6c7ff2484236 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:31.331058 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1be1642-f3ac-45cb-b297-6c7ff2484236 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:31.331500 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1be1642-f3ac-45cb-b297-6c7ff2484236 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:31.332251 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1be1642-f3ac-45cb-b297-6c7ff2484236 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:31.332678 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1be1642-f3ac-45cb-b297-6c7ff2484236 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:31.461450 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d1be1642-f3ac-45cb-b297-6c7ff2484236 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:31.469515 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d1be1642-f3ac-45cb-b297-6c7ff2484236 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1368 microversion: 2.1 time: 0.149906 Jun 21 08:20:31.470089 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 309/681] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:31 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:32.483613 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:32.484398 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=6 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:32.489202 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-2e272fdb-b653-4d61-9488-bec0de0aa536 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:32.489888 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-2e272fdb-b653-4d61-9488-bec0de0aa536 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:32.497699 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2e272fdb-b653-4d61-9488-bec0de0aa536 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:32.498138 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2e272fdb-b653-4d61-9488-bec0de0aa536 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:32.498915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2e272fdb-b653-4d61-9488-bec0de0aa536 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:32.499349 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2e272fdb-b653-4d61-9488-bec0de0aa536 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:32.630545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2e272fdb-b653-4d61-9488-bec0de0aa536 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:32.638255 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-2e272fdb-b653-4d61-9488-bec0de0aa536 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1368 microversion: 2.1 time: 0.155603 Jun 21 08:20:32.638836 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 373/682] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:32 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:33.607184 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8d4913f8-4393-46be-9348-0fa0e1a8445a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:33.608179 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8d4913f8-4393-46be-9348-0fa0e1a8445a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:33.610098 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=6 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:33.615793 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8d4913f8-4393-46be-9348-0fa0e1a8445a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:33.616240 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8d4913f8-4393-46be-9348-0fa0e1a8445a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:33.616998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8d4913f8-4393-46be-9348-0fa0e1a8445a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:33.617430 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8d4913f8-4393-46be-9348-0fa0e1a8445a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:33.642971 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:33.647402 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8d4913f8-4393-46be-9348-0fa0e1a8445a tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044387 Jun 21 08:20:33.647950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 310/683] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:20:33 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:20:33.654882 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5033bbf9-5c46-4dc6-94f8-63156c4fe4b0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:33.655557 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5033bbf9-5c46-4dc6-94f8-63156c4fe4b0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:33.662192 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5033bbf9-5c46-4dc6-94f8-63156c4fe4b0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:33.662676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5033bbf9-5c46-4dc6-94f8-63156c4fe4b0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:33.663442 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5033bbf9-5c46-4dc6-94f8-63156c4fe4b0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:33.663882 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5033bbf9-5c46-4dc6-94f8-63156c4fe4b0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:33.705370 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-aa30050d-6ada-4fd1-8a38-f915a0cb193e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:33.705875 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-aa30050d-6ada-4fd1-8a38-f915a0cb193e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:33.712613 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aa30050d-6ada-4fd1-8a38-f915a0cb193e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:33.713320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aa30050d-6ada-4fd1-8a38-f915a0cb193e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:33.714104 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aa30050d-6ada-4fd1-8a38-f915a0cb193e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:33.714544 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aa30050d-6ada-4fd1-8a38-f915a0cb193e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:33.740440 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-aa30050d-6ada-4fd1-8a38-f915a0cb193e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:20:33.792643 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5033bbf9-5c46-4dc6-94f8-63156c4fe4b0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:33.800608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5033bbf9-5c46-4dc6-94f8-63156c4fe4b0 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1557 microversion: 2.1 time: 0.149539 Jun 21 08:20:33.801181 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 374/684] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:33 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:33.817374 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1f8cf53b-5e43-472c-bde4-00dbfdae919b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:33.817688 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-aa30050d-6ada-4fd1-8a38-f915a0cb193e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 204 len: 0 microversion: 2.1 time: 0.115634 Jun 21 08:20:33.817995 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1f8cf53b-5e43-472c-bde4-00dbfdae919b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:33.821342 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 311/685] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:20:33 2022] DELETE /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 08:20:33.825175 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1f8cf53b-5e43-472c-bde4-00dbfdae919b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:33.825617 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1f8cf53b-5e43-472c-bde4-00dbfdae919b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:33.826391 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1f8cf53b-5e43-472c-bde4-00dbfdae919b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:33.826928 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1f8cf53b-5e43-472c-bde4-00dbfdae919b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:33.827586 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0f9f7ee9-75cd-43de-afe6-b248cd9a2942 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:33.828311 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0f9f7ee9-75cd-43de-afe6-b248cd9a2942 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:33.835529 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0f9f7ee9-75cd-43de-afe6-b248cd9a2942 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:33.835984 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0f9f7ee9-75cd-43de-afe6-b248cd9a2942 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:33.836757 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0f9f7ee9-75cd-43de-afe6-b248cd9a2942 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:33.837193 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0f9f7ee9-75cd-43de-afe6-b248cd9a2942 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:33.907120 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1f8cf53b-5e43-472c-bde4-00dbfdae919b tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093486 Jun 21 08:20:33.907721 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 375/686] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 08:20:33 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:33.968741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0f9f7ee9-75cd-43de-afe6-b248cd9a2942 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:33.976244 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0f9f7ee9-75cd-43de-afe6-b248cd9a2942 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1674 microversion: 2.1 time: 0.153739 Jun 21 08:20:33.976811 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 312/687] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:33 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:34.818561 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-d37b90e0-d1d3-4aa3-b72f-8ee1efd10efb req-87990bb3-94c2-4587-9399-d9a7763e30b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed508fef-cc9b-42c9-b954-0e52c65a1d12", "tag": "d6dff98b-1192-424a-9a7e-a012cd149f34"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:34.827132 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-d37b90e0-d1d3-4aa3-b72f-8ee1efd10efb req-87990bb3-94c2-4587-9399-d9a7763e30b4 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:34.827571 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-d37b90e0-d1d3-4aa3-b72f-8ee1efd10efb req-87990bb3-94c2-4587-9399-d9a7763e30b4 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:34.839103 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-d37b90e0-d1d3-4aa3-b72f-8ee1efd10efb req-87990bb3-94c2-4587-9399-d9a7763e30b4 service nova] Creating event network-changed:d6dff98b-1192-424a-9a7e-a012cd149f34 for instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 on hv-cinder-83697 Jun 21 08:20:34.843925 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-d37b90e0-d1d3-4aa3-b72f-8ee1efd10efb req-87990bb3-94c2-4587-9399-d9a7763e30b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029709 Jun 21 08:20:34.844512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 376/688] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:34.993313 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-562ee27e-3569-4d4a-9b6d-9ed4d0a63267 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:34.993935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-562ee27e-3569-4d4a-9b6d-9ed4d0a63267 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:35.000618 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-562ee27e-3569-4d4a-9b6d-9ed4d0a63267 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:35.001065 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-562ee27e-3569-4d4a-9b6d-9ed4d0a63267 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:35.002094 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-562ee27e-3569-4d4a-9b6d-9ed4d0a63267 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:35.002531 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-562ee27e-3569-4d4a-9b6d-9ed4d0a63267 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:35.134594 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-562ee27e-3569-4d4a-9b6d-9ed4d0a63267 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:35.143018 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-562ee27e-3569-4d4a-9b6d-9ed4d0a63267 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1674 microversion: 2.1 time: 0.153341 Jun 21 08:20:35.143604 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 313/689] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:34 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:36.161025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c6a82779-960c-472d-89a2-44b260286641 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:36.161721 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c6a82779-960c-472d-89a2-44b260286641 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:36.169076 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c6a82779-960c-472d-89a2-44b260286641 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:36.169523 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c6a82779-960c-472d-89a2-44b260286641 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:36.170290 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c6a82779-960c-472d-89a2-44b260286641 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:36.170755 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c6a82779-960c-472d-89a2-44b260286641 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:36.302916 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c6a82779-960c-472d-89a2-44b260286641 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:36.311004 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c6a82779-960c-472d-89a2-44b260286641 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1674 microversion: 2.1 time: 0.154564 Jun 21 08:20:36.320638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 377/690] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:36 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:37.052138 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-8c55e6d8-e4f1-4263-b6fe-5f30d77a16f5 req-12701d74-4a51-4970-b845-6ad8ce01ab8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb2c496-4e45-441d-839c-09445870d85e", "name": "network-vif-deleted", "tag": "26d5d4da-35f8-4ab6-9617-7a5e462e84b3"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:37.060598 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-8c55e6d8-e4f1-4263-b6fe-5f30d77a16f5 req-12701d74-4a51-4970-b845-6ad8ce01ab8c service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:37.061271 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-8c55e6d8-e4f1-4263-b6fe-5f30d77a16f5 req-12701d74-4a51-4970-b845-6ad8ce01ab8c service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:37.073449 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-8c55e6d8-e4f1-4263-b6fe-5f30d77a16f5 req-12701d74-4a51-4970-b845-6ad8ce01ab8c service nova] Creating event network-vif-deleted:26d5d4da-35f8-4ab6-9617-7a5e462e84b3 for instance dfb2c496-4e45-441d-839c-09445870d85e on hv-cinder-83697 Jun 21 08:20:37.078946 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-8c55e6d8-e4f1-4263-b6fe-5f30d77a16f5 req-12701d74-4a51-4970-b845-6ad8ce01ab8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030281 Jun 21 08:20:37.079542 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 314/691] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:37.327798 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:37.328423 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:37.334785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:37.335223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:37.335968 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:37.336393 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:37.367471 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:37.367839 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:37.368278 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lazy-loading 'fault' on Instance uuid dfb2c496-4e45-441d-839c-09445870d85e {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:20:37.410304 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:37.418987 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ebe24796-e0d5-4356-9bf2-159ef26928fe tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 200 len: 1327 microversion: 2.1 time: 0.095036 Jun 21 08:20:37.419777 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 378/692] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:37 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:38.437824 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-29275648-4b10-43be-b3f2-e3a58f7c32e1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:38.438447 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-29275648-4b10-43be-b3f2-e3a58f7c32e1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:38.444754 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-29275648-4b10-43be-b3f2-e3a58f7c32e1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:38.445223 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-29275648-4b10-43be-b3f2-e3a58f7c32e1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:38.445984 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-29275648-4b10-43be-b3f2-e3a58f7c32e1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:38.446418 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-29275648-4b10-43be-b3f2-e3a58f7c32e1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:38.459382 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-29275648-4b10-43be-b3f2-e3a58f7c32e1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] HTTP exception thrown: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-29275648-4b10-43be-b3f2-e3a58f7c32e1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Request method failure captured: Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e HTTP/1.1 Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4iw7wqV_nRnR5IXSM3tRapD_UCQs18DxqupPgStCeDxiSRGIjKQ6RxgmEx45MWQvqgqdeMaH8pVEF-rfWiJn3GDToBrwpMCXVIO7iW_mUjMNlf_joknI1DT5SdMSmKulsUfOkfUKUNSkVtPUgWlNcoSXPhQdJpPNfl8W5H_5GFs-o Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:20:38.460975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c4b18684de44714b4a54442a17720b7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 62c0039007d641c0aedaa781acaa0abe Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:20:38.462815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'dfb2c496-4e45-441d-839c-09445870d85e'} Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:20:38.463907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:20:38.465405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:38.466881 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-29275648-4b10-43be-b3f2-e3a58f7c32e1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Returning 404 to user: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:20:38.466881 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-29275648-4b10-43be-b3f2-e3a58f7c32e1 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 404 len: 111 microversion: 2.1 time: 0.029393 Jun 21 08:20:38.466881 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 315/693] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:38 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:20:38.471442 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c9d5f407-a9a3-447c-a56a-b7ef9e24da07 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '.version_select at 0x7fded2ead430>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:38.488880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c9d5f407-a9a3-447c-a56a-b7ef9e24da07 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052974073" status: 202 len: 0 microversion: 2.1 time: 0.021186 Jun 21 08:20:38.489423 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 379/694] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jun 21 08:20:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052974073 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:20:39.112117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-97e4e783-7987-4ab6-beb0-37d1974b07bc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'create', calling method: .version_select at 0x7fded2e1a040>, body: {"keypair": {"name": "tempest-keypair-1266089221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbAOnWlNQ5r8aX6lZFe12MSLzOVLBq7v44sInYEUaY8fovxA+r8Tsz+aHcGkfgmjTg8COjQKaFvYFBq5LnrOSR3n8GhFAmsbulujpon2p0kB22BBZkLIfk8Cgbm8DPYig=="}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:39.133520 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-97e4e783-7987-4ab6-beb0-37d1974b07bc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Getting quotas for project 9c4b18684de44714b4a54442a17720b7. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:20:39.138357 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-97e4e783-7987-4ab6-beb0-37d1974b07bc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Getting quotas for user 62c0039007d641c0aedaa781acaa0abe and project 9c4b18684de44714b4a54442a17720b7. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:20:39.160010 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-97e4e783-7987-4ab6-beb0-37d1974b07bc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051803 Jun 21 08:20:39.160611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 316/695] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 08:20:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:40.366075 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2038465249", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1563a5ad-132e-4800-8264-c4bbc3c987e3"}], "security_groups": [{"name": "tempest-securitygroup--2054205210"}], "key_name": "tempest-keypair-1266089221", "user_data": "}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:40.467910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] validate_networks() for [('1563a5ad-132e-4800-8264-c4bbc3c987e3', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:20:40.926808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:20:40.927326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:20:40.927807 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:20:40.928218 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:20:40.928630 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:20:40.938168 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:40.938640 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:40.939473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:40.939908 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:40.956397 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Getting quotas for project 9c4b18684de44714b4a54442a17720b7. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:20:40.960318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Getting quotas for user 62c0039007d641c0aedaa781acaa0abe and project 9c4b18684de44714b4a54442a17720b7. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:20:40.971195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:20:40.973534 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:20:41.022308 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-075fae1f-fba6-4a20-afdd-2215ed3013cc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.660920 Jun 21 08:20:41.023982 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 380/696] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:20:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:20:41.034050 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-058e3f2f-5cbc-43a7-9d26-cc86f7aabeea tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:41.034912 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-058e3f2f-5cbc-43a7-9d26-cc86f7aabeea tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:41.037123 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:41.096819 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-058e3f2f-5cbc-43a7-9d26-cc86f7aabeea tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:41.103943 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-058e3f2f-5cbc-43a7-9d26-cc86f7aabeea tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1238 microversion: 2.1 time: 0.073717 Jun 21 08:20:41.104670 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 317/697] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:41 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:41.668804 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-edeca5ce-9b9d-4271-8dc3-109122b640e0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:41.669328 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-edeca5ce-9b9d-4271-8dc3-109122b640e0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:41.675866 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-edeca5ce-9b9d-4271-8dc3-109122b640e0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:41.676324 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-edeca5ce-9b9d-4271-8dc3-109122b640e0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:41.677089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-edeca5ce-9b9d-4271-8dc3-109122b640e0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:41.677525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-edeca5ce-9b9d-4271-8dc3-109122b640e0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:41.762472 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-edeca5ce-9b9d-4271-8dc3-109122b640e0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lazy-loading 'services' on Instance uuid 9636db4b-57b1-4e11-832b-584baecd8ed2 {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:20:41.843608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-edeca5ce-9b9d-4271-8dc3-109122b640e0 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments/e6fabbd9-ef32-451e-a630-4d9c0866293c" status: 202 len: 0 microversion: 2.1 time: 0.178584 Jun 21 08:20:41.844227 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 381/698] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:20:41 2022] DELETE /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments/e6fabbd9-ef32-451e-a630-4d9c0866293c => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 08:20:41.853621 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c99f37a7-cf97-4b8f-8c83-6bfb61bec35c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:41.854770 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c99f37a7-cf97-4b8f-8c83-6bfb61bec35c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:41.867626 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c99f37a7-cf97-4b8f-8c83-6bfb61bec35c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:41.868128 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c99f37a7-cf97-4b8f-8c83-6bfb61bec35c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:41.869488 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c99f37a7-cf97-4b8f-8c83-6bfb61bec35c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:41.870008 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c99f37a7-cf97-4b8f-8c83-6bfb61bec35c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:41.899354 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c99f37a7-cf97-4b8f-8c83-6bfb61bec35c tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049922 Jun 21 08:20:41.899912 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 318/699] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:20:41 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:42.123033 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b1f60ccc-ba62-4079-a444-0d7e1be53b94 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:42.124140 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b1f60ccc-ba62-4079-a444-0d7e1be53b94 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:42.133824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1f60ccc-ba62-4079-a444-0d7e1be53b94 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:42.134556 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1f60ccc-ba62-4079-a444-0d7e1be53b94 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:42.135973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1f60ccc-ba62-4079-a444-0d7e1be53b94 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:42.136485 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1f60ccc-ba62-4079-a444-0d7e1be53b94 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:42.213406 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b1f60ccc-ba62-4079-a444-0d7e1be53b94 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:42.220902 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b1f60ccc-ba62-4079-a444-0d7e1be53b94 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1298 microversion: 2.1 time: 0.103642 Jun 21 08:20:42.221466 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 382/700] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:42 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:42.911146 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-15782e87-4096-4b08-bc75-9b5400b730bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:42.912077 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-15782e87-4096-4b08-bc75-9b5400b730bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:42.919316 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-15782e87-4096-4b08-bc75-9b5400b730bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:42.919768 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-15782e87-4096-4b08-bc75-9b5400b730bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:42.920538 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-15782e87-4096-4b08-bc75-9b5400b730bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:42.920998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-15782e87-4096-4b08-bc75-9b5400b730bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:42.951462 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-15782e87-4096-4b08-bc75-9b5400b730bb tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044222 Jun 21 08:20:42.952029 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 319/701] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:20:42 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:20:43.025507 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ffc1c509-e002-4c0a-ae0d-c63a5470137d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:43.031854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ffc1c509-e002-4c0a-ae0d-c63a5470137d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:43.040301 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ffc1c509-e002-4c0a-ae0d-c63a5470137d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:43.041722 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ffc1c509-e002-4c0a-ae0d-c63a5470137d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:43.042577 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ffc1c509-e002-4c0a-ae0d-c63a5470137d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:43.042992 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ffc1c509-e002-4c0a-ae0d-c63a5470137d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:43.059833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:43.072317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ffc1c509-e002-4c0a-ae0d-c63a5470137d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Going to try to terminate instance {{(pid=117547) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:20:43.161777 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ffc1c509-e002-4c0a-ae0d-c63a5470137d tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 204 len: 0 microversion: 2.1 time: 0.139920 Jun 21 08:20:43.162523 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 383/702] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:20:43 2022] DELETE /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:20:43.171220 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-51f4cc55-a836-4f78-8d81-f4892c9e3ba4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:43.171858 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-51f4cc55-a836-4f78-8d81-f4892c9e3ba4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:43.178895 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-51f4cc55-a836-4f78-8d81-f4892c9e3ba4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:43.179337 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-51f4cc55-a836-4f78-8d81-f4892c9e3ba4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:43.180091 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-51f4cc55-a836-4f78-8d81-f4892c9e3ba4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:43.180692 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-51f4cc55-a836-4f78-8d81-f4892c9e3ba4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:43.239227 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4807ead1-948b-4733-9d55-8096b06d1a61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:43.239957 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4807ead1-948b-4733-9d55-8096b06d1a61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:43.246643 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4807ead1-948b-4733-9d55-8096b06d1a61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:43.247048 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4807ead1-948b-4733-9d55-8096b06d1a61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:43.247859 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4807ead1-948b-4733-9d55-8096b06d1a61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:43.248249 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4807ead1-948b-4733-9d55-8096b06d1a61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:43.391994 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4807ead1-948b-4733-9d55-8096b06d1a61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:43.399519 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4807ead1-948b-4733-9d55-8096b06d1a61 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.164647 Jun 21 08:20:43.400601 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 384/703] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:43 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:43.415448 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-51f4cc55-a836-4f78-8d81-f4892c9e3ba4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:43.426713 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-51f4cc55-a836-4f78-8d81-f4892c9e3ba4 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1690 microversion: 2.1 time: 0.259206 Jun 21 08:20:43.427297 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 320/704] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:43 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1690 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:43.777415 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-7abf9f52-f6d5-4af1-9587-333ce8ea5ca7 req-ae0c408a-4a57-4b2a-b13b-ea1a39b8f6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87aee4df-7232-4331-a685-0c07836cb986", "tag": "0e1b22d6-9bc6-4f54-96b6-0b460eb9ef12"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:43.786675 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-7abf9f52-f6d5-4af1-9587-333ce8ea5ca7 req-ae0c408a-4a57-4b2a-b13b-ea1a39b8f6b9 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:43.786923 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-7abf9f52-f6d5-4af1-9587-333ce8ea5ca7 req-ae0c408a-4a57-4b2a-b13b-ea1a39b8f6b9 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:43.804509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-7abf9f52-f6d5-4af1-9587-333ce8ea5ca7 req-ae0c408a-4a57-4b2a-b13b-ea1a39b8f6b9 service nova] Creating event network-changed:0e1b22d6-9bc6-4f54-96b6-0b460eb9ef12 for instance 87aee4df-7232-4331-a685-0c07836cb986 on hv-cinder-83697 Jun 21 08:20:43.809780 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-7abf9f52-f6d5-4af1-9587-333ce8ea5ca7 req-ae0c408a-4a57-4b2a-b13b-ea1a39b8f6b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036565 Jun 21 08:20:43.810699 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 385/705] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:44.418089 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f33a352c-6670-47d9-bc35-8b3eb20f2c11 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:44.418657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f33a352c-6670-47d9-bc35-8b3eb20f2c11 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:44.425180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f33a352c-6670-47d9-bc35-8b3eb20f2c11 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:44.425624 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f33a352c-6670-47d9-bc35-8b3eb20f2c11 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:44.426374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f33a352c-6670-47d9-bc35-8b3eb20f2c11 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:44.426837 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f33a352c-6670-47d9-bc35-8b3eb20f2c11 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:44.445117 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-473616ac-a7b8-423e-bdaf-f357c8c3684f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:44.445955 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-473616ac-a7b8-423e-bdaf-f357c8c3684f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:44.452646 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-473616ac-a7b8-423e-bdaf-f357c8c3684f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:44.453099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-473616ac-a7b8-423e-bdaf-f357c8c3684f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:44.453861 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-473616ac-a7b8-423e-bdaf-f357c8c3684f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:44.454297 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-473616ac-a7b8-423e-bdaf-f357c8c3684f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:44.557741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f33a352c-6670-47d9-bc35-8b3eb20f2c11 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:44.565573 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f33a352c-6670-47d9-bc35-8b3eb20f2c11 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.151639 Jun 21 08:20:44.574595 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 321/706] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:44 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:44.594897 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-473616ac-a7b8-423e-bdaf-f357c8c3684f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:44.602198 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-473616ac-a7b8-423e-bdaf-f357c8c3684f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1690 microversion: 2.1 time: 0.161730 Jun 21 08:20:44.602765 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 386/707] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:44 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:45.581412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0a4a2319-d96b-45aa-bda9-562885ffaefc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:45.582021 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0a4a2319-d96b-45aa-bda9-562885ffaefc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:45.588570 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0a4a2319-d96b-45aa-bda9-562885ffaefc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:45.589012 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0a4a2319-d96b-45aa-bda9-562885ffaefc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:45.589769 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0a4a2319-d96b-45aa-bda9-562885ffaefc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:45.590196 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0a4a2319-d96b-45aa-bda9-562885ffaefc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:45.620432 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a06b17e1-9d92-461e-8ff8-abce745fcd25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:45.621053 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a06b17e1-9d92-461e-8ff8-abce745fcd25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:45.627885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a06b17e1-9d92-461e-8ff8-abce745fcd25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:45.628339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a06b17e1-9d92-461e-8ff8-abce745fcd25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:45.629105 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a06b17e1-9d92-461e-8ff8-abce745fcd25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:45.629538 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a06b17e1-9d92-461e-8ff8-abce745fcd25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:45.720653 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0a4a2319-d96b-45aa-bda9-562885ffaefc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:45.727964 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0a4a2319-d96b-45aa-bda9-562885ffaefc tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.150414 Jun 21 08:20:45.728562 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 322/708] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:45 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:45.759584 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a06b17e1-9d92-461e-8ff8-abce745fcd25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:45.767044 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a06b17e1-9d92-461e-8ff8-abce745fcd25 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1690 microversion: 2.1 time: 0.151282 Jun 21 08:20:45.767600 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 387/709] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:45 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:46.745092 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-11386fda-99ab-4860-81c0-193adced449e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:46.745723 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-11386fda-99ab-4860-81c0-193adced449e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:46.752479 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-11386fda-99ab-4860-81c0-193adced449e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:46.752928 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-11386fda-99ab-4860-81c0-193adced449e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:46.753703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-11386fda-99ab-4860-81c0-193adced449e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:46.754139 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-11386fda-99ab-4860-81c0-193adced449e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:46.785019 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7b82308c-e1a2-4667-a8af-d5c8f2956f0f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:46.785848 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7b82308c-e1a2-4667-a8af-d5c8f2956f0f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:46.792635 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b82308c-e1a2-4667-a8af-d5c8f2956f0f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:46.793165 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b82308c-e1a2-4667-a8af-d5c8f2956f0f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:46.794021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b82308c-e1a2-4667-a8af-d5c8f2956f0f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:46.794525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b82308c-e1a2-4667-a8af-d5c8f2956f0f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:46.925128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7b82308c-e1a2-4667-a8af-d5c8f2956f0f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:46.933582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7b82308c-e1a2-4667-a8af-d5c8f2956f0f tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1690 microversion: 2.1 time: 0.152481 Jun 21 08:20:46.934167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 388/710] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:46 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:47.338552 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-11386fda-99ab-4860-81c0-193adced449e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:47.345974 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-11386fda-99ab-4860-81c0-193adced449e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.604904 Jun 21 08:20:47.346548 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 323/711] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:46 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:47.877075 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-1891b059-d2c7-4ac8-8643-210bbb534586 req-699cb4e5-510e-4b82-b909-d60f5393cab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9636db4b-57b1-4e11-832b-584baecd8ed2", "name": "network-vif-deleted", "tag": "2cf35fad-280a-42ee-a53d-2d69eb288575"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:47.886214 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-1891b059-d2c7-4ac8-8643-210bbb534586 req-699cb4e5-510e-4b82-b909-d60f5393cab2 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:47.886673 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-1891b059-d2c7-4ac8-8643-210bbb534586 req-699cb4e5-510e-4b82-b909-d60f5393cab2 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:47.897319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-1891b059-d2c7-4ac8-8643-210bbb534586 req-699cb4e5-510e-4b82-b909-d60f5393cab2 service nova] Creating event network-vif-deleted:2cf35fad-280a-42ee-a53d-2d69eb288575 for instance 9636db4b-57b1-4e11-832b-584baecd8ed2 on hv-cinder-83697 Jun 21 08:20:47.903280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-1891b059-d2c7-4ac8-8643-210bbb534586 req-699cb4e5-510e-4b82-b909-d60f5393cab2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030061 Jun 21 08:20:47.903873 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 389/712] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:47.951553 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-cb454da3-5699-4515-8c4a-8849c04174ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:47.952168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-cb454da3-5699-4515-8c4a-8849c04174ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:47.958826 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cb454da3-5699-4515-8c4a-8849c04174ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:47.959272 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cb454da3-5699-4515-8c4a-8849c04174ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:47.960040 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cb454da3-5699-4515-8c4a-8849c04174ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:47.960475 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cb454da3-5699-4515-8c4a-8849c04174ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:48.029064 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-cb454da3-5699-4515-8c4a-8849c04174ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:48.038655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-cb454da3-5699-4515-8c4a-8849c04174ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 200 len: 1622 microversion: 2.1 time: 0.091781 Jun 21 08:20:48.039247 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 324/713] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:47 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 1622 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:48.364056 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-04cd8ae0-eee1-4a83-a1d3-c34fd3e6601b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:48.364914 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-04cd8ae0-eee1-4a83-a1d3-c34fd3e6601b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:48.373829 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04cd8ae0-eee1-4a83-a1d3-c34fd3e6601b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:48.374299 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04cd8ae0-eee1-4a83-a1d3-c34fd3e6601b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:48.375355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04cd8ae0-eee1-4a83-a1d3-c34fd3e6601b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:48.375795 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-04cd8ae0-eee1-4a83-a1d3-c34fd3e6601b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:48.514405 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-04cd8ae0-eee1-4a83-a1d3-c34fd3e6601b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:48.522133 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-04cd8ae0-eee1-4a83-a1d3-c34fd3e6601b tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.162244 Jun 21 08:20:48.523015 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 390/714] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:48 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:49.057464 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fb3d2704-ec15-4c90-9df5-b8181e00defc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:49.058061 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-fb3d2704-ec15-4c90-9df5-b8181e00defc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 9636db4b-57b1-4e11-832b-584baecd8ed2] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:49.064804 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fb3d2704-ec15-4c90-9df5-b8181e00defc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:49.065187 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fb3d2704-ec15-4c90-9df5-b8181e00defc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:49.065949 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fb3d2704-ec15-4c90-9df5-b8181e00defc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:49.066420 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fb3d2704-ec15-4c90-9df5-b8181e00defc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:49.080275 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-fb3d2704-ec15-4c90-9df5-b8181e00defc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] HTTP exception thrown: Instance 9636db4b-57b1-4e11-832b-584baecd8ed2 could not be found. Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fb3d2704-ec15-4c90-9df5-b8181e00defc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Request method failure captured: Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 HTTP/1.1 Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4kw49eR-vbnBBhtDk_dfaC58ianxrNvQU-ghNVYEt5aSDOdJQr6rzlG7AbzaYFlP3Nx37QATSOBYxXOIuAPPLyANNgQF2TidMGs6Ceo68Tpl0m1pqj9Lyuaz61drO8mnz15JVyHEo6wXUzhlesQAyQT3WzfUYYe3uqvIbFIo_3ZzA Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 2001b029fae0472d8ef7b6fd658ad191 Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:20:49.081800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2001b029fae0472d8ef7b6fd658ad191", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 2001b029fae0472d8ef7b6fd658ad191 Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-ServerRescueNegativeTestJSON-1558605599-project Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 771f36afce0a4dd8897bb22f3c330856 Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1558605599-project Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 9636db4b-57b1-4e11-832b-584baecd8ed2 could not be found. Jun 21 08:20:49.083423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '9636db4b-57b1-4e11-832b-584baecd8ed2'} Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9636db4b-57b1-4e11-832b-584baecd8ed2 could not be found. Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:20:49.084320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9636db4b-57b1-4e11-832b-584baecd8ed2 could not be found. Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9636db4b-57b1-4e11-832b-584baecd8ed2 could not be found. Jun 21 08:20:49.085504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:20:49.086550 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fb3d2704-ec15-4c90-9df5-b8181e00defc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Returning 404 to user: Instance 9636db4b-57b1-4e11-832b-584baecd8ed2 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:20:49.086550 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fb3d2704-ec15-4c90-9df5-b8181e00defc tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2" status: 404 len: 111 microversion: 2.1 time: 0.030514 Jun 21 08:20:49.086550 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 325/715] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:49 2022] GET /compute/v2.1/servers/9636db4b-57b1-4e11-832b-584baecd8ed2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:20:49.091881 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1d604acd-52a1-4b3a-b144-449352894244 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '.version_select at 0x7fded2eada60>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:49.110687 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1d604acd-52a1-4b3a-b144-449352894244 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-690890215" status: 202 len: 0 microversion: 2.1 time: 0.022465 Jun 21 08:20:49.111241 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 391/716] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 21 08:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-690890215 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:20:49.539637 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4fe69fa6-79ce-4187-bc83-09e828132b09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:49.540279 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4fe69fa6-79ce-4187-bc83-09e828132b09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:49.547336 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4fe69fa6-79ce-4187-bc83-09e828132b09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:49.547778 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4fe69fa6-79ce-4187-bc83-09e828132b09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:49.548554 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4fe69fa6-79ce-4187-bc83-09e828132b09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:49.548981 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4fe69fa6-79ce-4187-bc83-09e828132b09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:49.683153 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4fe69fa6-79ce-4187-bc83-09e828132b09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:49.690490 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4fe69fa6-79ce-4187-bc83-09e828132b09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.154753 Jun 21 08:20:49.691074 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 326/717] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:49 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:50.708603 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-471920a2-d890-47e3-8dd4-2c67755f0fe6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:50.709210 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-471920a2-d890-47e3-8dd4-2c67755f0fe6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:50.715933 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-471920a2-d890-47e3-8dd4-2c67755f0fe6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:50.716380 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-471920a2-d890-47e3-8dd4-2c67755f0fe6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:50.717342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-471920a2-d890-47e3-8dd4-2c67755f0fe6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:50.717770 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-471920a2-d890-47e3-8dd4-2c67755f0fe6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:50.847015 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-471920a2-d890-47e3-8dd4-2c67755f0fe6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:50.855335 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-471920a2-d890-47e3-8dd4-2c67755f0fe6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.150909 Jun 21 08:20:50.855971 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 392/718] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:50 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:51.872783 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f9778614-563c-46fb-b1f9-896f8c702948 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:51.873392 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f9778614-563c-46fb-b1f9-896f8c702948 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:51.875688 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=6 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:51.881374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f9778614-563c-46fb-b1f9-896f8c702948 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:51.881816 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f9778614-563c-46fb-b1f9-896f8c702948 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:51.882565 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f9778614-563c-46fb-b1f9-896f8c702948 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:51.883021 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f9778614-563c-46fb-b1f9-896f8c702948 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:52.011403 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f9778614-563c-46fb-b1f9-896f8c702948 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:52.018769 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f9778614-563c-46fb-b1f9-896f8c702948 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.150560 Jun 21 08:20:52.019323 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 327/719] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:51 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:52.194072 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6b1627c3-d8ff-4270-9b61-d4a0f417b074 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:52.194552 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6b1627c3-d8ff-4270-9b61-d4a0f417b074 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:52.196559 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:52.197347 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=6 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:52.204484 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6b1627c3-d8ff-4270-9b61-d4a0f417b074 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:52.205011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6b1627c3-d8ff-4270-9b61-d4a0f417b074 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:52.205726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6b1627c3-d8ff-4270-9b61-d4a0f417b074 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:52.206161 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6b1627c3-d8ff-4270-9b61-d4a0f417b074 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:52.231811 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6b1627c3-d8ff-4270-9b61-d4a0f417b074 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Going to try to terminate instance {{(pid=117547) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:20:52.308525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6b1627c3-d8ff-4270-9b61-d4a0f417b074 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 204 len: 0 microversion: 2.1 time: 0.117899 Jun 21 08:20:52.309228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 393/720] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:20:52 2022] DELETE /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:20:52.317045 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f50f8793-b08e-4816-8436-d0aea831b0e6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:52.317655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f50f8793-b08e-4816-8436-d0aea831b0e6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:52.323654 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f50f8793-b08e-4816-8436-d0aea831b0e6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:52.324124 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f50f8793-b08e-4816-8436-d0aea831b0e6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:52.324873 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f50f8793-b08e-4816-8436-d0aea831b0e6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:52.325299 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f50f8793-b08e-4816-8436-d0aea831b0e6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:52.451010 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f50f8793-b08e-4816-8436-d0aea831b0e6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:52.458388 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f50f8793-b08e-4816-8436-d0aea831b0e6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1507 microversion: 2.1 time: 0.145135 Jun 21 08:20:52.458991 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 328/721] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:52 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:52.989246 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-dbb03775-c9ef-4ec2-b631-5fa05c98cd85 req-b8ca056f-3e7e-44a6-8c95-c519d973df92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87aee4df-7232-4331-a685-0c07836cb986", "name": "network-vif-plugged", "status": "completed", "tag": "0e1b22d6-9bc6-4f54-96b6-0b460eb9ef12"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:52.998371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-dbb03775-c9ef-4ec2-b631-5fa05c98cd85 req-b8ca056f-3e7e-44a6-8c95-c519d973df92 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:52.998995 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-dbb03775-c9ef-4ec2-b631-5fa05c98cd85 req-b8ca056f-3e7e-44a6-8c95-c519d973df92 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:53.010470 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-dbb03775-c9ef-4ec2-b631-5fa05c98cd85 req-b8ca056f-3e7e-44a6-8c95-c519d973df92 service nova] Creating event network-vif-plugged:0e1b22d6-9bc6-4f54-96b6-0b460eb9ef12 for instance 87aee4df-7232-4331-a685-0c07836cb986 on hv-cinder-83697 Jun 21 08:20:53.015972 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-dbb03775-c9ef-4ec2-b631-5fa05c98cd85 req-b8ca056f-3e7e-44a6-8c95-c519d973df92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030797 Jun 21 08:20:53.016731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 394/722] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:53.035196 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-183ed712-44d1-4ea9-9f13-f36d3486bfbf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:53.035845 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-183ed712-44d1-4ea9-9f13-f36d3486bfbf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:53.042340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-183ed712-44d1-4ea9-9f13-f36d3486bfbf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:53.042938 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-183ed712-44d1-4ea9-9f13-f36d3486bfbf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:53.043715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-183ed712-44d1-4ea9-9f13-f36d3486bfbf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:53.044154 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-183ed712-44d1-4ea9-9f13-f36d3486bfbf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:53.173110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-183ed712-44d1-4ea9-9f13-f36d3486bfbf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:53.175319 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:53.181757 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-183ed712-44d1-4ea9-9f13-f36d3486bfbf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.150333 Jun 21 08:20:53.182320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 329/723] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:53 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:53.475921 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-2ed46fc2-379f-4c03-99ec-36b8ec469efa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:53.476611 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-2ed46fc2-379f-4c03-99ec-36b8ec469efa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:53.482910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2ed46fc2-379f-4c03-99ec-36b8ec469efa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:53.483356 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2ed46fc2-379f-4c03-99ec-36b8ec469efa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:53.484107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2ed46fc2-379f-4c03-99ec-36b8ec469efa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:53.484537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2ed46fc2-379f-4c03-99ec-36b8ec469efa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:53.618099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2ed46fc2-379f-4c03-99ec-36b8ec469efa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:53.625561 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-2ed46fc2-379f-4c03-99ec-36b8ec469efa tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1507 microversion: 2.1 time: 0.154302 Jun 21 08:20:53.626121 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 395/724] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:53 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:54.199700 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-78e48802-89a2-4060-aa81-c5c878a44d09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:54.200324 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-78e48802-89a2-4060-aa81-c5c878a44d09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:54.208655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-78e48802-89a2-4060-aa81-c5c878a44d09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:54.209107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-78e48802-89a2-4060-aa81-c5c878a44d09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:54.209887 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-78e48802-89a2-4060-aa81-c5c878a44d09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:54.210325 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-78e48802-89a2-4060-aa81-c5c878a44d09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:54.346144 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-78e48802-89a2-4060-aa81-c5c878a44d09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:54.353409 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-78e48802-89a2-4060-aa81-c5c878a44d09 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.158131 Jun 21 08:20:54.353972 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 330/725] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:54 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:54.643053 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-bde13b91-84e6-4245-b081-883da3794b2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:54.643685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-bde13b91-84e6-4245-b081-883da3794b2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:54.650182 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bde13b91-84e6-4245-b081-883da3794b2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:54.650662 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bde13b91-84e6-4245-b081-883da3794b2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:54.651428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bde13b91-84e6-4245-b081-883da3794b2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:54.651870 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bde13b91-84e6-4245-b081-883da3794b2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:54.783974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-bde13b91-84e6-4245-b081-883da3794b2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:54.791723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-bde13b91-84e6-4245-b081-883da3794b2e tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1507 microversion: 2.1 time: 0.152453 Jun 21 08:20:54.792444 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 396/726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:54 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:55.196740 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-11573f5f-c8f3-46af-8b2a-79fc29d829c5 req-853b379a-37ab-490d-9e07-748d2c964e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a94231b-1d32-451c-87ec-0b8264564d27", "name": "network-vif-deleted", "tag": "1cc80cea-1318-4662-be70-c38f26b1e312"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:55.208015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-11573f5f-c8f3-46af-8b2a-79fc29d829c5 req-853b379a-37ab-490d-9e07-748d2c964e8f service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:55.209212 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-11573f5f-c8f3-46af-8b2a-79fc29d829c5 req-853b379a-37ab-490d-9e07-748d2c964e8f service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:55.224942 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-11573f5f-c8f3-46af-8b2a-79fc29d829c5 req-853b379a-37ab-490d-9e07-748d2c964e8f service nova] Creating event network-vif-deleted:1cc80cea-1318-4662-be70-c38f26b1e312 for instance 7a94231b-1d32-451c-87ec-0b8264564d27 on hv-cinder-83697 Jun 21 08:20:55.232242 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-11573f5f-c8f3-46af-8b2a-79fc29d829c5 req-853b379a-37ab-490d-9e07-748d2c964e8f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040715 Jun 21 08:20:55.233078 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 331/727] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:55.370389 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e8509abd-15cb-4ec2-a124-2c6ffbfcb2a6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:55.371529 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e8509abd-15cb-4ec2-a124-2c6ffbfcb2a6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:55.377772 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e8509abd-15cb-4ec2-a124-2c6ffbfcb2a6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:55.378280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e8509abd-15cb-4ec2-a124-2c6ffbfcb2a6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:55.379081 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e8509abd-15cb-4ec2-a124-2c6ffbfcb2a6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:55.379602 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e8509abd-15cb-4ec2-a124-2c6ffbfcb2a6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:55.515849 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e8509abd-15cb-4ec2-a124-2c6ffbfcb2a6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:55.523565 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e8509abd-15cb-4ec2-a124-2c6ffbfcb2a6 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1364 microversion: 2.1 time: 0.156981 Jun 21 08:20:55.524130 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 397/728] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:55 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:55.809875 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:55.810702 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:55.817649 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:55.818096 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:55.818873 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:55.819303 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:55.849825 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:55.850265 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:55.850724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lazy-loading 'fault' on Instance uuid 7a94231b-1d32-451c-87ec-0b8264564d27 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:20:55.893019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:55.900623 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-57da6ef4-5de0-45c1-b63d-3d6c84bb8374 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 200 len: 1311 microversion: 2.1 time: 0.095551 Jun 21 08:20:55.901571 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 332/729] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:55 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:56.540656 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7ef8d580-4fb4-4b1c-b5bc-00476577c288 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:56.541274 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7ef8d580-4fb4-4b1c-b5bc-00476577c288 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:56.544190 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:56.549717 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7ef8d580-4fb4-4b1c-b5bc-00476577c288 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:56.550169 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7ef8d580-4fb4-4b1c-b5bc-00476577c288 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:56.551048 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7ef8d580-4fb4-4b1c-b5bc-00476577c288 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:56.551484 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7ef8d580-4fb4-4b1c-b5bc-00476577c288 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:56.688683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7ef8d580-4fb4-4b1c-b5bc-00476577c288 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:56.696006 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7ef8d580-4fb4-4b1c-b5bc-00476577c288 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1549 microversion: 2.1 time: 0.159199 Jun 21 08:20:56.696558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 398/730] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:56 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:56.712424 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5aa637a7-9839-4ffa-b1b6-16069523b8cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:56.712900 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5aa637a7-9839-4ffa-b1b6-16069523b8cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:56.719993 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5aa637a7-9839-4ffa-b1b6-16069523b8cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:56.720441 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5aa637a7-9839-4ffa-b1b6-16069523b8cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:56.721201 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5aa637a7-9839-4ffa-b1b6-16069523b8cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:56.721632 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5aa637a7-9839-4ffa-b1b6-16069523b8cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:56.797830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5aa637a7-9839-4ffa-b1b6-16069523b8cd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089299 Jun 21 08:20:56.798459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 333/731] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 08:20:56 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:56.917229 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a58029bc-0254-4656-938c-6a4210ba44f6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:56.917843 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a58029bc-0254-4656-938c-6a4210ba44f6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: 7a94231b-1d32-451c-87ec-0b8264564d27] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:56.923797 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a58029bc-0254-4656-938c-6a4210ba44f6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:56.924240 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a58029bc-0254-4656-938c-6a4210ba44f6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:56.924994 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a58029bc-0254-4656-938c-6a4210ba44f6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:56.925425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a58029bc-0254-4656-938c-6a4210ba44f6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:56.939291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-a58029bc-0254-4656-938c-6a4210ba44f6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] HTTP exception thrown: Instance 7a94231b-1d32-451c-87ec-0b8264564d27 could not be found. Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a58029bc-0254-4656-938c-6a4210ba44f6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Request method failure captured: Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 HTTP/1.1 Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX4kw49eR-vbnBBhtDk_dfaC58ianxrNvQU-ghNVYEt5aSDOdJQr6rzlG7AbzaYFlP3Nx37QATSOBYxXOIuAPPLyANNgQF2TidMGs6Ceo68Tpl0m1pqj9Lyuaz61drO8mnz15JVyHEo6wXUzhlesQAyQT3WzfUYYe3uqvIbFIo_3ZzA Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 2001b029fae0472d8ef7b6fd658ad191 Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:20:56.940915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2001b029fae0472d8ef7b6fd658ad191", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 2001b029fae0472d8ef7b6fd658ad191 Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-ServerRescueNegativeTestJSON-1558605599-project Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 771f36afce0a4dd8897bb22f3c330856 Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1558605599-project Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 7a94231b-1d32-451c-87ec-0b8264564d27 could not be found. Jun 21 08:20:56.942479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '7a94231b-1d32-451c-87ec-0b8264564d27'} Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a94231b-1d32-451c-87ec-0b8264564d27 could not be found. Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:20:56.943608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a94231b-1d32-451c-87ec-0b8264564d27 could not be found. Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a94231b-1d32-451c-87ec-0b8264564d27 could not be found. Jun 21 08:20:56.945016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:20:56.946382 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a58029bc-0254-4656-938c-6a4210ba44f6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Returning 404 to user: Instance 7a94231b-1d32-451c-87ec-0b8264564d27 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:20:56.946382 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a58029bc-0254-4656-938c-6a4210ba44f6 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27" status: 404 len: 111 microversion: 2.1 time: 0.028922 Jun 21 08:20:56.946382 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 399/732] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:56 2022] GET /compute/v2.1/servers/7a94231b-1d32-451c-87ec-0b8264564d27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:20:56.952245 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-dc34d58a-72f4-47c8-8ba0-eac302bc3089 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:56.952865 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-dc34d58a-72f4-47c8-8ba0-eac302bc3089 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:56.958945 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc34d58a-72f4-47c8-8ba0-eac302bc3089 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:56.959474 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc34d58a-72f4-47c8-8ba0-eac302bc3089 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:56.960311 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc34d58a-72f4-47c8-8ba0-eac302bc3089 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:56.960815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dc34d58a-72f4-47c8-8ba0-eac302bc3089 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:56.986962 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-dc34d58a-72f4-47c8-8ba0-eac302bc3089 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:20:57.063747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-dc34d58a-72f4-47c8-8ba0-eac302bc3089 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 204 len: 0 microversion: 2.1 time: 0.115632 Jun 21 08:20:57.066668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 334/733] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:20:56 2022] DELETE /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:20:57.072563 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d0e8c6ad-34c5-4804-8d66-99d448726266 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:57.074214 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d0e8c6ad-34c5-4804-8d66-99d448726266 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:57.080544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0e8c6ad-34c5-4804-8d66-99d448726266 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:57.080995 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0e8c6ad-34c5-4804-8d66-99d448726266 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:57.081811 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0e8c6ad-34c5-4804-8d66-99d448726266 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:57.082246 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0e8c6ad-34c5-4804-8d66-99d448726266 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:57.097460 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:57.221055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d0e8c6ad-34c5-4804-8d66-99d448726266 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:57.228559 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d0e8c6ad-34c5-4804-8d66-99d448726266 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.160192 Jun 21 08:20:57.229339 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 400/734] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:57 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:20:57.818937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-20b88b17-2eb5-4547-9a05-a16993074ea0 req-2761762e-57fb-4170-914d-9bb11612f1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87aee4df-7232-4331-a685-0c07836cb986", "tag": "0e1b22d6-9bc6-4f54-96b6-0b460eb9ef12"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:57.827699 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-20b88b17-2eb5-4547-9a05-a16993074ea0 req-2761762e-57fb-4170-914d-9bb11612f1c5 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:57.828123 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-20b88b17-2eb5-4547-9a05-a16993074ea0 req-2761762e-57fb-4170-914d-9bb11612f1c5 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:57.840563 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-20b88b17-2eb5-4547-9a05-a16993074ea0 req-2761762e-57fb-4170-914d-9bb11612f1c5 service nova] Creating event network-changed:0e1b22d6-9bc6-4f54-96b6-0b460eb9ef12 for instance 87aee4df-7232-4331-a685-0c07836cb986 on hv-cinder-83697 Jun 21 08:20:57.846312 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-20b88b17-2eb5-4547-9a05-a16993074ea0 req-2761762e-57fb-4170-914d-9bb11612f1c5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092349 Jun 21 08:20:57.847200 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 335/735] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:20:58.255506 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-32e6e910-5704-4e72-aa4d-3117a9f04103 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:58.256255 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-32e6e910-5704-4e72-aa4d-3117a9f04103 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:58.265530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-32e6e910-5704-4e72-aa4d-3117a9f04103 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:58.265530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-32e6e910-5704-4e72-aa4d-3117a9f04103 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:58.266482 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-32e6e910-5704-4e72-aa4d-3117a9f04103 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:58.267171 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-32e6e910-5704-4e72-aa4d-3117a9f04103 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:58.402197 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-32e6e910-5704-4e72-aa4d-3117a9f04103 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:58.409675 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-32e6e910-5704-4e72-aa4d-3117a9f04103 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.164345 Jun 21 08:20:58.410237 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 401/736] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:58 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:59.428184 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d2f8170c-6f24-4026-9c71-ffef7e30c8d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:59.428900 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d2f8170c-6f24-4026-9c71-ffef7e30c8d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:59.435949 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2f8170c-6f24-4026-9c71-ffef7e30c8d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:59.436390 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2f8170c-6f24-4026-9c71-ffef7e30c8d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:59.437144 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2f8170c-6f24-4026-9c71-ffef7e30c8d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:59.437583 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2f8170c-6f24-4026-9c71-ffef7e30c8d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:59.483991 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f5c02a1b-4332-4e28-8570-0b6f606ef9cc tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:20:59.484584 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f5c02a1b-4332-4e28-8570-0b6f606ef9cc tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:59.491176 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f5c02a1b-4332-4e28-8570-0b6f606ef9cc tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:59.491705 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f5c02a1b-4332-4e28-8570-0b6f606ef9cc tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:59.492605 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f5c02a1b-4332-4e28-8570-0b6f606ef9cc tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:59.493108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f5c02a1b-4332-4e28-8570-0b6f606ef9cc tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:59.516272 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-f5c02a1b-4332-4e28-8570-0b6f606ef9cc tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lazy-loading 'flavor' on Instance uuid d983b34e-0d69-4afd-9bb6-f13213be6bb1 {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:20:59.597708 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f5c02a1b-4332-4e28-8570-0b6f606ef9cc tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "POST /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1/action" status: 202 len: 0 microversion: 2.1 time: 0.117747 Jun 21 08:20:59.599290 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 402/737] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:20:59 2022] POST /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 08:20:59.607134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d2f8170c-6f24-4026-9c71-ffef7e30c8d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:59.608264 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b0f7c774-90a8-4a48-af48-81b3a565d752 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:20:59.609820 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b0f7c774-90a8-4a48-af48-81b3a565d752 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:20:59.615236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b0f7c774-90a8-4a48-af48-81b3a565d752 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:59.615407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d2f8170c-6f24-4026-9c71-ffef7e30c8d9 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.191288 Jun 21 08:20:59.615684 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b0f7c774-90a8-4a48-af48-81b3a565d752 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:59.622732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 336/738] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:59 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:20:59.622922 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b0f7c774-90a8-4a48-af48-81b3a565d752 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:20:59.622922 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b0f7c774-90a8-4a48-af48-81b3a565d752 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:20:59.750777 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b0f7c774-90a8-4a48-af48-81b3a565d752 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:20:59.759013 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b0f7c774-90a8-4a48-af48-81b3a565d752 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.155203 Jun 21 08:20:59.759568 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 403/739] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:20:59 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:21:00.631657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3598beec-082f-44bc-8162-c17f26017da5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:00.632242 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3598beec-082f-44bc-8162-c17f26017da5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:00.639255 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3598beec-082f-44bc-8162-c17f26017da5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:00.639773 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3598beec-082f-44bc-8162-c17f26017da5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:00.640596 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3598beec-082f-44bc-8162-c17f26017da5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:00.641090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3598beec-082f-44bc-8162-c17f26017da5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:00.776380 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-bf486886-8783-47eb-9b2d-5630e834402a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:00.777419 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-bf486886-8783-47eb-9b2d-5630e834402a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:00.783925 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bf486886-8783-47eb-9b2d-5630e834402a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:00.784379 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bf486886-8783-47eb-9b2d-5630e834402a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:00.785351 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bf486886-8783-47eb-9b2d-5630e834402a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:00.785796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-bf486886-8783-47eb-9b2d-5630e834402a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:00.861181 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3598beec-082f-44bc-8162-c17f26017da5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771f36afce0a4dd8897bb22f3c330856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2001b029fae0472d8ef7b6fd658ad191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:00.871646 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3598beec-082f-44bc-8162-c17f26017da5 tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 200 len: 1521 microversion: 2.1 time: 0.243591 Jun 21 08:21:00.872374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 337/740] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:00 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:00.922558 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-6dfb21e7-23e9-4624-96cf-4eade880b607 req-5302eb6e-ccef-48fd-b812-711ce9c68b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe8e00a-97d1-4e7c-8a02-db6a981670fc", "name": "network-vif-deleted", "tag": "401a4b2e-926f-405f-af0e-bb07243e04fc"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:00.937704 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-bf486886-8783-47eb-9b2d-5630e834402a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:00.939732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-6dfb21e7-23e9-4624-96cf-4eade880b607 req-5302eb6e-ccef-48fd-b812-711ce9c68b14 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:00.942399 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-6dfb21e7-23e9-4624-96cf-4eade880b607 req-5302eb6e-ccef-48fd-b812-711ce9c68b14 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:00.954577 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-6dfb21e7-23e9-4624-96cf-4eade880b607 req-5302eb6e-ccef-48fd-b812-711ce9c68b14 service nova] Creating event network-vif-deleted:401a4b2e-926f-405f-af0e-bb07243e04fc for instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc on hv-cinder-83697 Jun 21 08:21:00.958509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-bf486886-8783-47eb-9b2d-5630e834402a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.185154 Jun 21 08:21:00.959236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 404/741] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:00 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:21:00.959799 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-6dfb21e7-23e9-4624-96cf-4eade880b607 req-5302eb6e-ccef-48fd-b812-711ce9c68b14 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040820 Jun 21 08:21:00.960465 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 338/742] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:01.888666 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dc926faa-c638-41f9-a525-03ae01d0b6ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:01.889220 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-dc926faa-c638-41f9-a525-03ae01d0b6ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] [instance: ebe8e00a-97d1-4e7c-8a02-db6a981670fc] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:01.895549 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dc926faa-c638-41f9-a525-03ae01d0b6ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:01.895993 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dc926faa-c638-41f9-a525-03ae01d0b6ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:01.896740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dc926faa-c638-41f9-a525-03ae01d0b6ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:01.897310 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dc926faa-c638-41f9-a525-03ae01d0b6ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:01.910885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-dc926faa-c638-41f9-a525-03ae01d0b6ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] HTTP exception thrown: Instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc could not be found. Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dc926faa-c638-41f9-a525-03ae01d0b6ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Request method failure captured: Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc HTTP/1.1 Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX4kw49eR-vbnBBhtDk_dfaC58ianxrNvQU-ghNVYEt5aSDOdJQr6rzlG7AbzaYFlP3Nx37QATSOBYxXOIuAPPLyANNgQF2TidMGs6Ceo68Tpl0m1pqj9Lyuaz61drO8mnz15JVyHEo6wXUzhlesQAyQT3WzfUYYe3uqvIbFIo_3ZzA Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 2001b029fae0472d8ef7b6fd658ad191 Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:21:01.912475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2001b029fae0472d8ef7b6fd658ad191"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2001b029fae0472d8ef7b6fd658ad191", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 2001b029fae0472d8ef7b6fd658ad191 Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1558605599 Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-ServerRescueNegativeTestJSON-1558605599-project Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 771f36afce0a4dd8897bb22f3c330856 Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1558605599-project Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc could not be found. Jun 21 08:21:01.914167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'ebe8e00a-97d1-4e7c-8a02-db6a981670fc'} Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc could not be found. Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:21:01.915127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc could not be found. Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc could not be found. Jun 21 08:21:01.916638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:01.918650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dc926faa-c638-41f9-a525-03ae01d0b6ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] Returning 404 to user: Instance ebe8e00a-97d1-4e7c-8a02-db6a981670fc could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:21:01.918650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-dc926faa-c638-41f9-a525-03ae01d0b6ef tempest-ServerRescueNegativeTestJSON-1558605599 tempest-ServerRescueNegativeTestJSON-1558605599-project] 10.222.0.36 "GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc" status: 404 len: 111 microversion: 2.1 time: 0.029729 Jun 21 08:21:01.918650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 405/743] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:01 2022] GET /compute/v2.1/servers/ebe8e00a-97d1-4e7c-8a02-db6a981670fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:21:01.977288 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4ee86579-e5fa-48d5-8fcb-97b52ec1ae07 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:01.978106 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4ee86579-e5fa-48d5-8fcb-97b52ec1ae07 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:01.984376 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ee86579-e5fa-48d5-8fcb-97b52ec1ae07 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:01.984901 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ee86579-e5fa-48d5-8fcb-97b52ec1ae07 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:01.985742 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ee86579-e5fa-48d5-8fcb-97b52ec1ae07 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:01.986186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ee86579-e5fa-48d5-8fcb-97b52ec1ae07 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:02.232793 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4ee86579-e5fa-48d5-8fcb-97b52ec1ae07 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:02.240365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4ee86579-e5fa-48d5-8fcb-97b52ec1ae07 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.267834 Jun 21 08:21:02.240995 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 339/744] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:01 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:03.258106 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fb6c82f3-d5c8-46d3-a1b8-cea5f30d8af0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:03.258764 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fb6c82f3-d5c8-46d3-a1b8-cea5f30d8af0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:03.266050 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fb6c82f3-d5c8-46d3-a1b8-cea5f30d8af0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:03.266503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fb6c82f3-d5c8-46d3-a1b8-cea5f30d8af0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:03.267312 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fb6c82f3-d5c8-46d3-a1b8-cea5f30d8af0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:03.267745 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fb6c82f3-d5c8-46d3-a1b8-cea5f30d8af0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:03.397411 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fb6c82f3-d5c8-46d3-a1b8-cea5f30d8af0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:03.406073 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fb6c82f3-d5c8-46d3-a1b8-cea5f30d8af0 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.151770 Jun 21 08:21:03.406444 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 406/745] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:03 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:04.423459 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5116e4d0-afe0-487a-a99a-6abd1d765719 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:04.424064 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5116e4d0-afe0-487a-a99a-6abd1d765719 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:04.430899 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5116e4d0-afe0-487a-a99a-6abd1d765719 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:04.431345 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5116e4d0-afe0-487a-a99a-6abd1d765719 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:04.432101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5116e4d0-afe0-487a-a99a-6abd1d765719 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:04.433049 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5116e4d0-afe0-487a-a99a-6abd1d765719 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:04.592466 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5116e4d0-afe0-487a-a99a-6abd1d765719 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:04.600813 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5116e4d0-afe0-487a-a99a-6abd1d765719 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.181488 Jun 21 08:21:04.602685 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 340/746] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:04 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:05.618545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4f542835-56a5-46bb-b2e4-5138feefa0e6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:05.619132 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4f542835-56a5-46bb-b2e4-5138feefa0e6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:05.625569 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4f542835-56a5-46bb-b2e4-5138feefa0e6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:05.626013 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4f542835-56a5-46bb-b2e4-5138feefa0e6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:05.626809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4f542835-56a5-46bb-b2e4-5138feefa0e6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:05.627489 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4f542835-56a5-46bb-b2e4-5138feefa0e6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:05.774447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4f542835-56a5-46bb-b2e4-5138feefa0e6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:05.783675 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4f542835-56a5-46bb-b2e4-5138feefa0e6 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.168967 Jun 21 08:21:05.784236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 407/747] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:05 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:06.802514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e6446d02-5633-4abf-b0e3-c9ec38eb5381 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:06.803171 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e6446d02-5633-4abf-b0e3-c9ec38eb5381 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:06.812163 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e6446d02-5633-4abf-b0e3-c9ec38eb5381 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:06.812809 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e6446d02-5633-4abf-b0e3-c9ec38eb5381 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:06.814231 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e6446d02-5633-4abf-b0e3-c9ec38eb5381 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:06.814859 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e6446d02-5633-4abf-b0e3-c9ec38eb5381 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:06.983043 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e6446d02-5633-4abf-b0e3-c9ec38eb5381 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:06.991538 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e6446d02-5633-4abf-b0e3-c9ec38eb5381 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.193956 Jun 21 08:21:06.992276 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 341/748] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:06 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:08.008816 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b4c85782-cd20-4ddf-84be-58e4175db559 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:08.010009 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b4c85782-cd20-4ddf-84be-58e4175db559 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:08.017618 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b4c85782-cd20-4ddf-84be-58e4175db559 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:08.018277 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b4c85782-cd20-4ddf-84be-58e4175db559 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:08.019080 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b4c85782-cd20-4ddf-84be-58e4175db559 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:08.019514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b4c85782-cd20-4ddf-84be-58e4175db559 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:08.499242 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b4c85782-cd20-4ddf-84be-58e4175db559 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:08.510999 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b4c85782-cd20-4ddf-84be-58e4175db559 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.505747 Jun 21 08:21:08.512206 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 408/749] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:08 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:09.529209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-aa245356-c177-4869-86bf-9c2b1fda1f68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:09.529882 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-aa245356-c177-4869-86bf-9c2b1fda1f68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:09.537937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aa245356-c177-4869-86bf-9c2b1fda1f68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:09.538428 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aa245356-c177-4869-86bf-9c2b1fda1f68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:09.539637 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aa245356-c177-4869-86bf-9c2b1fda1f68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:09.540449 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-aa245356-c177-4869-86bf-9c2b1fda1f68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:09.693752 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-aa245356-c177-4869-86bf-9c2b1fda1f68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:09.702960 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-aa245356-c177-4869-86bf-9c2b1fda1f68 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.178363 Jun 21 08:21:09.703864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 342/750] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:09 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:10.473297 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-13c67b73-8cf5-4151-8354-39c9af708dca tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Action: 'create', calling method: .version_select at 0x7fded2df4e50>, body: {"keypair": {"name": "tempest-keypair-553355533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMEbx9T/79y4YKLbtFkPf+DpQJ6G0Ijuh5PAIu6w8uRPLuTUM67sXZm8EjuRntlaYLJp1TJA5KLm6roLxtqtz37Gy2MfRv8U72y4G3UOXYkSjlckMXkUFasAycJW5ELlg=="}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:10.487998 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-13c67b73-8cf5-4151-8354-39c9af708dca tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Getting quotas for project df68cafb6dcd4a8c9e9593d3f13500f0. Resources: {'key_pairs'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:21:10.491989 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-13c67b73-8cf5-4151-8354-39c9af708dca tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Getting quotas for user 2bc6e732127845a6be56f9b8be728f14 and project df68cafb6dcd4a8c9e9593d3f13500f0. Resources: {'key_pairs'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:21:10.516674 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-13c67b73-8cf5-4151-8354-39c9af708dca tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.223561 Jun 21 08:21:10.517263 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 409/751] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Jun 21 08:21:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 225 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 08:21:10.719907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4bce9d7b-7d2a-415a-a341-f22a3d81bd36 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:10.720614 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4bce9d7b-7d2a-415a-a341-f22a3d81bd36 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:10.729090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4bce9d7b-7d2a-415a-a341-f22a3d81bd36 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:10.730126 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4bce9d7b-7d2a-415a-a341-f22a3d81bd36 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:10.730950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4bce9d7b-7d2a-415a-a341-f22a3d81bd36 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:10.731564 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4bce9d7b-7d2a-415a-a341-f22a3d81bd36 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:10.928408 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4bce9d7b-7d2a-415a-a341-f22a3d81bd36 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:10.928622 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e7d0e4bf-b173-4e4e-8aeb-d3ff31a8dfc3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:10.928951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e7d0e4bf-b173-4e4e-8aeb-d3ff31a8dfc3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:10.939717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4bce9d7b-7d2a-415a-a341-f22a3d81bd36 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.223722 Jun 21 08:21:10.941346 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7d0e4bf-b173-4e4e-8aeb-d3ff31a8dfc3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:10.942165 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 343/752] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:10 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:10.942805 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7d0e4bf-b173-4e4e-8aeb-d3ff31a8dfc3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:10.943827 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7d0e4bf-b173-4e4e-8aeb-d3ff31a8dfc3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:10.944458 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e7d0e4bf-b173-4e4e-8aeb-d3ff31a8dfc3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:10.971494 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e7d0e4bf-b173-4e4e-8aeb-d3ff31a8dfc3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/ips" status: 200 len: 149 microversion: 2.1 time: 0.047052 Jun 21 08:21:10.972293 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 410/753] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 08:21:10 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:11.959918 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-dbf9099c-bcba-47c4-97b7-eb368548955d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:11.960527 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-dbf9099c-bcba-47c4-97b7-eb368548955d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:11.962949 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:11.968952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dbf9099c-bcba-47c4-97b7-eb368548955d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:11.969399 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dbf9099c-bcba-47c4-97b7-eb368548955d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:11.970159 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dbf9099c-bcba-47c4-97b7-eb368548955d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:11.970651 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dbf9099c-bcba-47c4-97b7-eb368548955d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:12.173158 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-dbf9099c-bcba-47c4-97b7-eb368548955d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:12.184251 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-dbf9099c-bcba-47c4-97b7-eb368548955d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.228098 Jun 21 08:21:12.185709 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 344/754] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:11 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:12.339454 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1658054686", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "024039b9-9413-4bce-aeef-0421349b4da5"}], "security_groups": [{"name": "tempest-securitygroup--1598200864"}], "key_name": "tempest-keypair-553355533", "user_data": "}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:12.364197 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ff7e4a1b-2af8-4366-89e0-0b5497a70855 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "147ab110-e417-4137-b799-7c5f3f3a9b1d"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:12.365442 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-ff7e4a1b-2af8-4366-89e0-0b5497a70855 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:12.372815 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ff7e4a1b-2af8-4366-89e0-0b5497a70855 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:12.373346 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ff7e4a1b-2af8-4366-89e0-0b5497a70855 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:12.374302 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ff7e4a1b-2af8-4366-89e0-0b5497a70855 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:12.374918 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ff7e4a1b-2af8-4366-89e0-0b5497a70855 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:12.476389 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] validate_networks() for [('024039b9-9413-4bce-aeef-0421349b4da5', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:21:12.630201 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:12.658065 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ff7e4a1b-2af8-4366-89e0-0b5497a70855 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "POST /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297588 Jun 21 08:21:12.659105 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 345/755] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:21:12 2022] POST /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:21:12.910378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:21:12.910838 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:21:12.911344 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:21:12.911777 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:21:12.912350 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:21:12.921778 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:12.922352 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:12.923240 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:12.923673 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:12.941165 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Getting quotas for project df68cafb6dcd4a8c9e9593d3f13500f0. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:21:12.945100 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Getting quotas for user 2bc6e732127845a6be56f9b8be728f14 and project df68cafb6dcd4a8c9e9593d3f13500f0. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:21:12.957098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:21:12.959396 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:21:13.023996 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-81d4825c-ad70-4dd2-8b78-33277dc10a16 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.686917 Jun 21 08:21:13.024706 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 411/756] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Jun 21 08:21:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 21 08:21:13.035473 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-cfda7e78-176b-4f10-96a8-dc632d81a145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:13.036194 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-cfda7e78-176b-4f10-96a8-dc632d81a145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:13.131553 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-cfda7e78-176b-4f10-96a8-dc632d81a145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:13.140830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-cfda7e78-176b-4f10-96a8-dc632d81a145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:13.142382 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-cfda7e78-176b-4f10-96a8-dc632d81a145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:13.143588 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-cfda7e78-176b-4f10-96a8-dc632d81a145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1281 microversion: 2.20 time: 0.112320 Jun 21 08:21:13.144110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 346/757] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:13 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:21:13.201880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-08958406-4292-46bd-85fd-09d2d6193883 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:13.202499 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-08958406-4292-46bd-85fd-09d2d6193883 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:13.211767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-08958406-4292-46bd-85fd-09d2d6193883 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:13.212411 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-08958406-4292-46bd-85fd-09d2d6193883 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:13.213483 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-08958406-4292-46bd-85fd-09d2d6193883 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:13.214306 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-08958406-4292-46bd-85fd-09d2d6193883 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:13.405103 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-08958406-4292-46bd-85fd-09d2d6193883 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:13.413275 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-08958406-4292-46bd-85fd-09d2d6193883 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.215791 Jun 21 08:21:13.417348 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 412/758] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:13 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:14.161872 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-49734eae-91a3-4f42-852e-9bb24fe5cc09 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:14.163635 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-49734eae-91a3-4f42-852e-9bb24fe5cc09 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:14.171765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-49734eae-91a3-4f42-852e-9bb24fe5cc09 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:14.172690 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-49734eae-91a3-4f42-852e-9bb24fe5cc09 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:14.173745 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-49734eae-91a3-4f42-852e-9bb24fe5cc09 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:14.174404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-49734eae-91a3-4f42-852e-9bb24fe5cc09 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:14.305579 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-49734eae-91a3-4f42-852e-9bb24fe5cc09 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:14.319111 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-49734eae-91a3-4f42-852e-9bb24fe5cc09 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:14.321205 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-49734eae-91a3-4f42-852e-9bb24fe5cc09 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:14.326084 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-49734eae-91a3-4f42-852e-9bb24fe5cc09 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1341 microversion: 2.20 time: 0.165056 Jun 21 08:21:14.326736 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 347/759] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:14 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:21:14.433455 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fcd2898c-5066-4c57-9c16-67893ce61e18 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:14.434071 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fcd2898c-5066-4c57-9c16-67893ce61e18 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:14.440522 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fcd2898c-5066-4c57-9c16-67893ce61e18 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:14.440970 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fcd2898c-5066-4c57-9c16-67893ce61e18 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:14.441726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fcd2898c-5066-4c57-9c16-67893ce61e18 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:14.442163 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fcd2898c-5066-4c57-9c16-67893ce61e18 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:14.577955 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fcd2898c-5066-4c57-9c16-67893ce61e18 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:14.585642 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fcd2898c-5066-4c57-9c16-67893ce61e18 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.156682 Jun 21 08:21:14.586208 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 413/760] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:14 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:15.345000 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fc7d64bb-caec-46c0-89c3-6e7a8afd74b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:15.345609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-fc7d64bb-caec-46c0-89c3-6e7a8afd74b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:15.352020 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fc7d64bb-caec-46c0-89c3-6e7a8afd74b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:15.352458 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fc7d64bb-caec-46c0-89c3-6e7a8afd74b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:15.353204 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fc7d64bb-caec-46c0-89c3-6e7a8afd74b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:15.353630 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fc7d64bb-caec-46c0-89c3-6e7a8afd74b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:15.603214 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-93b3a61d-e52d-4f0b-a0e5-59985764aaeb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:15.603936 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-93b3a61d-e52d-4f0b-a0e5-59985764aaeb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:15.611147 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-93b3a61d-e52d-4f0b-a0e5-59985764aaeb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:15.611601 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-93b3a61d-e52d-4f0b-a0e5-59985764aaeb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:15.612378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-93b3a61d-e52d-4f0b-a0e5-59985764aaeb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:15.612819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-93b3a61d-e52d-4f0b-a0e5-59985764aaeb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:15.663107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fc7d64bb-caec-46c0-89c3-6e7a8afd74b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:15.672359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fc7d64bb-caec-46c0-89c3-6e7a8afd74b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:15.673935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fc7d64bb-caec-46c0-89c3-6e7a8afd74b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:15.675111 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fc7d64bb-caec-46c0-89c3-6e7a8afd74b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1407 microversion: 2.20 time: 0.334060 Jun 21 08:21:15.675862 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 348/761] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:15 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:21:15.759325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-93b3a61d-e52d-4f0b-a0e5-59985764aaeb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:15.767586 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-93b3a61d-e52d-4f0b-a0e5-59985764aaeb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.168303 Jun 21 08:21:15.768160 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 414/762] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:15 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:21:16.108017 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-48929352-f129-4591-a849-82ce70a5aa58 req-b0bd131f-0fbb-455c-a936-08b69fc4f8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c679db4c-d2f2-4b89-8027-39078f9bf5aa", "tag": "cf45f811-be66-426a-b1e5-e7bddc45e9f0"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:16.117058 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-48929352-f129-4591-a849-82ce70a5aa58 req-b0bd131f-0fbb-455c-a936-08b69fc4f8d0 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:16.117494 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-48929352-f129-4591-a849-82ce70a5aa58 req-b0bd131f-0fbb-455c-a936-08b69fc4f8d0 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:16.139140 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-48929352-f129-4591-a849-82ce70a5aa58 req-b0bd131f-0fbb-455c-a936-08b69fc4f8d0 service nova] Creating event network-changed:cf45f811-be66-426a-b1e5-e7bddc45e9f0 for instance c679db4c-d2f2-4b89-8027-39078f9bf5aa on hv-cinder-83697 Jun 21 08:21:16.144029 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-48929352-f129-4591-a849-82ce70a5aa58 req-b0bd131f-0fbb-455c-a936-08b69fc4f8d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040058 Jun 21 08:21:16.144630 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 349/763] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:16.693213 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-943109e2-6e16-40d8-b8e0-2e43fc8827cc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:16.693961 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-943109e2-6e16-40d8-b8e0-2e43fc8827cc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:16.700804 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-943109e2-6e16-40d8-b8e0-2e43fc8827cc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:16.701307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-943109e2-6e16-40d8-b8e0-2e43fc8827cc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:16.702069 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-943109e2-6e16-40d8-b8e0-2e43fc8827cc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:16.702481 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-943109e2-6e16-40d8-b8e0-2e43fc8827cc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:16.786954 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-70f6c135-a026-4c89-ba14-6777aa366c04 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:16.787676 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-70f6c135-a026-4c89-ba14-6777aa366c04 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:16.795587 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-70f6c135-a026-4c89-ba14-6777aa366c04 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:16.796034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-70f6c135-a026-4c89-ba14-6777aa366c04 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:16.796805 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-70f6c135-a026-4c89-ba14-6777aa366c04 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:16.797231 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-70f6c135-a026-4c89-ba14-6777aa366c04 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:16.833040 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-943109e2-6e16-40d8-b8e0-2e43fc8827cc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:16.841546 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-943109e2-6e16-40d8-b8e0-2e43fc8827cc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:16.843064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-943109e2-6e16-40d8-b8e0-2e43fc8827cc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:16.844168 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-943109e2-6e16-40d8-b8e0-2e43fc8827cc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1407 microversion: 2.20 time: 0.154868 Jun 21 08:21:16.844725 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 415/764] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:16 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:21:16.927756 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-70f6c135-a026-4c89-ba14-6777aa366c04 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:16.935245 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-70f6c135-a026-4c89-ba14-6777aa366c04 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.152968 Jun 21 08:21:16.935805 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 350/765] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:16 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:21:17.862887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-049723e3-11e4-4360-a2ff-b3a2e821cf17 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:17.864338 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-049723e3-11e4-4360-a2ff-b3a2e821cf17 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:17.872079 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-049723e3-11e4-4360-a2ff-b3a2e821cf17 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:17.872745 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-049723e3-11e4-4360-a2ff-b3a2e821cf17 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:17.873514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-049723e3-11e4-4360-a2ff-b3a2e821cf17 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:17.873979 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-049723e3-11e4-4360-a2ff-b3a2e821cf17 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:17.952759 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-027a9987-bd89-4039-8480-90ae2e830bf2 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:17.953323 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-027a9987-bd89-4039-8480-90ae2e830bf2 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:17.959892 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-027a9987-bd89-4039-8480-90ae2e830bf2 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:17.960340 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-027a9987-bd89-4039-8480-90ae2e830bf2 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:17.961096 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-027a9987-bd89-4039-8480-90ae2e830bf2 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:17.961523 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-027a9987-bd89-4039-8480-90ae2e830bf2 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:18.009741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-049723e3-11e4-4360-a2ff-b3a2e821cf17 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:18.020657 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-049723e3-11e4-4360-a2ff-b3a2e821cf17 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:18.022181 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-049723e3-11e4-4360-a2ff-b3a2e821cf17 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:18.023344 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-049723e3-11e4-4360-a2ff-b3a2e821cf17 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1407 microversion: 2.20 time: 0.164696 Jun 21 08:21:18.024127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 416/766] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:17 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:21:18.098350 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-027a9987-bd89-4039-8480-90ae2e830bf2 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:18.106134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-027a9987-bd89-4039-8480-90ae2e830bf2 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1572 microversion: 2.1 time: 0.157290 Jun 21 08:21:18.106723 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 351/767] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:17 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:21:18.122704 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7d605eb7-f689-484f-b321-3de586f00393 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:18.123279 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7d605eb7-f689-484f-b321-3de586f00393 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:18.129525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7d605eb7-f689-484f-b321-3de586f00393 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:18.129972 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7d605eb7-f689-484f-b321-3de586f00393 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:18.130760 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7d605eb7-f689-484f-b321-3de586f00393 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:18.131197 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7d605eb7-f689-484f-b321-3de586f00393 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:18.174569 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:18.221014 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7d605eb7-f689-484f-b321-3de586f00393 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "POST /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1/action" status: 202 len: 0 microversion: 2.1 time: 0.102839 Jun 21 08:21:18.221744 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 417/768] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 08:21:18 2022] POST /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:21:18.229635 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1be1484b-b271-4f38-b991-ff4b44a27b6b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:18.230245 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1be1484b-b271-4f38-b991-ff4b44a27b6b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:18.236281 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1be1484b-b271-4f38-b991-ff4b44a27b6b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:18.236732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1be1484b-b271-4f38-b991-ff4b44a27b6b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:18.237490 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1be1484b-b271-4f38-b991-ff4b44a27b6b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:18.237923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1be1484b-b271-4f38-b991-ff4b44a27b6b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:18.375640 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1be1484b-b271-4f38-b991-ff4b44a27b6b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:18.383863 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1be1484b-b271-4f38-b991-ff4b44a27b6b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1580 microversion: 2.1 time: 0.157999 Jun 21 08:21:18.384983 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 352/769] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:18 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1580 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:19.043527 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-03a0461a-6077-4848-ab7a-50212722a926 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:19.044121 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-03a0461a-6077-4848-ab7a-50212722a926 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:19.050024 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-03a0461a-6077-4848-ab7a-50212722a926 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:19.050471 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-03a0461a-6077-4848-ab7a-50212722a926 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:19.051267 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-03a0461a-6077-4848-ab7a-50212722a926 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:19.051703 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-03a0461a-6077-4848-ab7a-50212722a926 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:19.184362 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-03a0461a-6077-4848-ab7a-50212722a926 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:19.192234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-03a0461a-6077-4848-ab7a-50212722a926 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:19.193720 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-03a0461a-6077-4848-ab7a-50212722a926 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:19.195008 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-03a0461a-6077-4848-ab7a-50212722a926 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1407 microversion: 2.20 time: 0.156787 Jun 21 08:21:19.195568 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 418/770] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:19 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:21:19.401682 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6562a58c-355c-4813-9911-e1b049151c01 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:19.402311 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6562a58c-355c-4813-9911-e1b049151c01 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:19.408759 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6562a58c-355c-4813-9911-e1b049151c01 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:19.409206 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6562a58c-355c-4813-9911-e1b049151c01 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:19.409962 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6562a58c-355c-4813-9911-e1b049151c01 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:19.410393 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6562a58c-355c-4813-9911-e1b049151c01 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:19.546924 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6562a58c-355c-4813-9911-e1b049151c01 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:19.554451 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6562a58c-355c-4813-9911-e1b049151c01 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1522 microversion: 2.1 time: 0.157136 Jun 21 08:21:19.555097 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 353/771] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:19 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:20.213233 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a1b5a163-bcde-4718-840d-2558be035032 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:20.215246 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a1b5a163-bcde-4718-840d-2558be035032 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:20.223316 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a1b5a163-bcde-4718-840d-2558be035032 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:20.223711 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a1b5a163-bcde-4718-840d-2558be035032 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:20.224930 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a1b5a163-bcde-4718-840d-2558be035032 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:20.225585 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a1b5a163-bcde-4718-840d-2558be035032 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:20.325961 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c8149079-341b-4eb2-87ef-ea2d11919625 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:20.326445 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c8149079-341b-4eb2-87ef-ea2d11919625 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:20.332369 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c8149079-341b-4eb2-87ef-ea2d11919625 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:20.332812 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c8149079-341b-4eb2-87ef-ea2d11919625 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:20.333590 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c8149079-341b-4eb2-87ef-ea2d11919625 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:20.334019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c8149079-341b-4eb2-87ef-ea2d11919625 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:20.361747 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a1b5a163-bcde-4718-840d-2558be035032 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:20.370514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a1b5a163-bcde-4718-840d-2558be035032 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:20.372048 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a1b5a163-bcde-4718-840d-2558be035032 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:20.373157 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a1b5a163-bcde-4718-840d-2558be035032 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1407 microversion: 2.20 time: 0.163990 Jun 21 08:21:20.373717 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 419/772] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:20 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:21:20.414092 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-c8149079-341b-4eb2-87ef-ea2d11919625 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lazy-loading 'services' on Instance uuid ed508fef-cc9b-42c9-b954-0e52c65a1d12 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:21:20.488386 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c8149079-341b-4eb2-87ef-ea2d11919625 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/os-volume_attachments/147ab110-e417-4137-b799-7c5f3f3a9b1d" status: 202 len: 0 microversion: 2.1 time: 0.166061 Jun 21 08:21:20.489054 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 354/773] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:21:20 2022] DELETE /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/os-volume_attachments/147ab110-e417-4137-b799-7c5f3f3a9b1d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 08:21:20.497844 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0232fd51-e0c7-4fbe-9de6-10da77c215dc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:20.498852 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0232fd51-e0c7-4fbe-9de6-10da77c215dc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:20.505043 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0232fd51-e0c7-4fbe-9de6-10da77c215dc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:20.505538 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0232fd51-e0c7-4fbe-9de6-10da77c215dc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:20.506654 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0232fd51-e0c7-4fbe-9de6-10da77c215dc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:20.506997 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0232fd51-e0c7-4fbe-9de6-10da77c215dc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:20.544326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0232fd51-e0c7-4fbe-9de6-10da77c215dc tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050819 Jun 21 08:21:20.545273 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 420/774] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:21:20 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:20.573870 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-da6e7510-d960-48e1-a715-95c887327e6d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:20.575251 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-da6e7510-d960-48e1-a715-95c887327e6d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:20.584230 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-da6e7510-d960-48e1-a715-95c887327e6d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:20.584982 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-da6e7510-d960-48e1-a715-95c887327e6d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:20.585767 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-da6e7510-d960-48e1-a715-95c887327e6d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:20.586203 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-da6e7510-d960-48e1-a715-95c887327e6d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:20.716207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-da6e7510-d960-48e1-a715-95c887327e6d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:20.723724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-da6e7510-d960-48e1-a715-95c887327e6d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1578 microversion: 2.1 time: 0.154876 Jun 21 08:21:20.724288 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 355/775] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:20 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:21.392348 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9124a8ff-32ff-4ba0-bc78-9184bd0b7486 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:21.392988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9124a8ff-32ff-4ba0-bc78-9184bd0b7486 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:21.401087 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9124a8ff-32ff-4ba0-bc78-9184bd0b7486 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:21.401549 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9124a8ff-32ff-4ba0-bc78-9184bd0b7486 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:21.402304 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9124a8ff-32ff-4ba0-bc78-9184bd0b7486 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:21.402758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9124a8ff-32ff-4ba0-bc78-9184bd0b7486 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:21.535574 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9124a8ff-32ff-4ba0-bc78-9184bd0b7486 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:21.543603 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9124a8ff-32ff-4ba0-bc78-9184bd0b7486 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:21.545104 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9124a8ff-32ff-4ba0-bc78-9184bd0b7486 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:21.546201 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9124a8ff-32ff-4ba0-bc78-9184bd0b7486 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1407 microversion: 2.20 time: 0.157843 Jun 21 08:21:21.546786 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 421/776] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:21 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:21:21.555763 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ebd58842-810f-4857-9d6a-042afdc4114f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:21.556752 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-ebd58842-810f-4857-9d6a-042afdc4114f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:21.563885 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ebd58842-810f-4857-9d6a-042afdc4114f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:21.564334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ebd58842-810f-4857-9d6a-042afdc4114f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:21.565101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ebd58842-810f-4857-9d6a-042afdc4114f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:21.565538 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ebd58842-810f-4857-9d6a-042afdc4114f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:21.597465 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ebd58842-810f-4857-9d6a-042afdc4114f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045605 Jun 21 08:21:21.598020 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 356/777] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:21:21 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:21:21.655404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b79deebc-9ad0-4f7c-995c-7c7b8c5b0999 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:21.655905 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b79deebc-9ad0-4f7c-995c-7c7b8c5b0999 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:21.661996 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b79deebc-9ad0-4f7c-995c-7c7b8c5b0999 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:21.662448 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b79deebc-9ad0-4f7c-995c-7c7b8c5b0999 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:21.663252 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b79deebc-9ad0-4f7c-995c-7c7b8c5b0999 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:21.663688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b79deebc-9ad0-4f7c-995c-7c7b8c5b0999 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:21.690073 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b79deebc-9ad0-4f7c-995c-7c7b8c5b0999 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Going to try to terminate instance {{(pid=117547) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:21:21.741021 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d79d49a3-4221-4b1d-ab90-7711a5cc4c0d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:21.741631 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d79d49a3-4221-4b1d-ab90-7711a5cc4c0d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:21.749169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d79d49a3-4221-4b1d-ab90-7711a5cc4c0d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:21.749609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d79d49a3-4221-4b1d-ab90-7711a5cc4c0d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:21.750377 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d79d49a3-4221-4b1d-ab90-7711a5cc4c0d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:21.751172 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d79d49a3-4221-4b1d-ab90-7711a5cc4c0d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:21.766894 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b79deebc-9ad0-4f7c-995c-7c7b8c5b0999 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 204 len: 0 microversion: 2.1 time: 0.115117 Jun 21 08:21:21.768199 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 422/778] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:21:21 2022] DELETE /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:21:21.779659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ba4b0779-5ef5-41e6-b152-dbcd8b4089c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:21.780470 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ba4b0779-5ef5-41e6-b152-dbcd8b4089c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:21.786647 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ba4b0779-5ef5-41e6-b152-dbcd8b4089c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:21.787102 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ba4b0779-5ef5-41e6-b152-dbcd8b4089c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:21.787862 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ba4b0779-5ef5-41e6-b152-dbcd8b4089c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:21.788302 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ba4b0779-5ef5-41e6-b152-dbcd8b4089c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:21.892050 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d79d49a3-4221-4b1d-ab90-7711a5cc4c0d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:21.899466 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d79d49a3-4221-4b1d-ab90-7711a5cc4c0d tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1578 microversion: 2.1 time: 0.162728 Jun 21 08:21:21.900030 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 357/779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:21 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:21:21.921715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ba4b0779-5ef5-41e6-b152-dbcd8b4089c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:21.929275 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ba4b0779-5ef5-41e6-b152-dbcd8b4089c3 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1682 microversion: 2.1 time: 0.155905 Jun 21 08:21:21.929833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 423/780] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:21 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:22.563970 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b032135a-f0ad-4223-b9ed-50913981b5db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:22.564580 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b032135a-f0ad-4223-b9ed-50913981b5db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:22.571425 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b032135a-f0ad-4223-b9ed-50913981b5db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:22.571867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b032135a-f0ad-4223-b9ed-50913981b5db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:22.572696 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b032135a-f0ad-4223-b9ed-50913981b5db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:22.573121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b032135a-f0ad-4223-b9ed-50913981b5db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:22.702136 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b032135a-f0ad-4223-b9ed-50913981b5db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:22.710336 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b032135a-f0ad-4223-b9ed-50913981b5db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:22.711860 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b032135a-f0ad-4223-b9ed-50913981b5db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:22.712955 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b032135a-f0ad-4223-b9ed-50913981b5db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1407 microversion: 2.20 time: 0.152919 Jun 21 08:21:22.713925 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 358/781] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:22 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:21:22.916865 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3c97d4d0-7762-4858-87f7-a29151fbc7b5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:22.917489 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3c97d4d0-7762-4858-87f7-a29151fbc7b5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:22.923928 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3c97d4d0-7762-4858-87f7-a29151fbc7b5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:22.924371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3c97d4d0-7762-4858-87f7-a29151fbc7b5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:22.925122 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3c97d4d0-7762-4858-87f7-a29151fbc7b5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:22.925547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3c97d4d0-7762-4858-87f7-a29151fbc7b5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:22.929589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:22.947139 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-25eb1444-c13c-4011-8657-50e3c91ff98f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:22.947749 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-25eb1444-c13c-4011-8657-50e3c91ff98f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:22.954582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-25eb1444-c13c-4011-8657-50e3c91ff98f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:22.955059 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-25eb1444-c13c-4011-8657-50e3c91ff98f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:22.955860 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-25eb1444-c13c-4011-8657-50e3c91ff98f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:22.956292 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-25eb1444-c13c-4011-8657-50e3c91ff98f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:22.956544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=10 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:23.070394 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-3c97d4d0-7762-4858-87f7-a29151fbc7b5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:23.078229 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3c97d4d0-7762-4858-87f7-a29151fbc7b5 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1578 microversion: 2.1 time: 0.165762 Jun 21 08:21:23.079415 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 424/782] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:22 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:23.100703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-25eb1444-c13c-4011-8657-50e3c91ff98f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:23.108551 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-25eb1444-c13c-4011-8657-50e3c91ff98f tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1682 microversion: 2.1 time: 0.165330 Jun 21 08:21:23.109125 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 359/783] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:22 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:21:23.195346 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-7cbd51f9-05fe-4ca5-b194-a5b3a13899ef req-2e127500-b65d-4db5-8127-45b20704378a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c679db4c-d2f2-4b89-8027-39078f9bf5aa", "name": "network-vif-plugged", "status": "completed", "tag": "cf45f811-be66-426a-b1e5-e7bddc45e9f0"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:23.205088 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-7cbd51f9-05fe-4ca5-b194-a5b3a13899ef req-2e127500-b65d-4db5-8127-45b20704378a service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:23.205541 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-7cbd51f9-05fe-4ca5-b194-a5b3a13899ef req-2e127500-b65d-4db5-8127-45b20704378a service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:23.220570 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-7cbd51f9-05fe-4ca5-b194-a5b3a13899ef req-2e127500-b65d-4db5-8127-45b20704378a service nova] Creating event network-vif-plugged:cf45f811-be66-426a-b1e5-e7bddc45e9f0 for instance c679db4c-d2f2-4b89-8027-39078f9bf5aa on hv-cinder-83697 Jun 21 08:21:23.225604 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-7cbd51f9-05fe-4ca5-b194-a5b3a13899ef req-2e127500-b65d-4db5-8127-45b20704378a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093569 Jun 21 08:21:23.226199 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 425/784] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:21:23.736875 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-61aa510f-7b9d-47f7-bd19-e48269fbf6df tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:23.737659 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-61aa510f-7b9d-47f7-bd19-e48269fbf6df tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:23.740557 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:23.748344 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-61aa510f-7b9d-47f7-bd19-e48269fbf6df tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:23.748797 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-61aa510f-7b9d-47f7-bd19-e48269fbf6df tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:23.749583 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-61aa510f-7b9d-47f7-bd19-e48269fbf6df tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:23.750017 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-61aa510f-7b9d-47f7-bd19-e48269fbf6df tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:24.075324 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-61aa510f-7b9d-47f7-bd19-e48269fbf6df tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:24.083724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-61aa510f-7b9d-47f7-bd19-e48269fbf6df tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:24.085434 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-61aa510f-7b9d-47f7-bd19-e48269fbf6df tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:24.086594 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-61aa510f-7b9d-47f7-bd19-e48269fbf6df tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1407 microversion: 2.20 time: 0.355498 Jun 21 08:21:24.087199 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 360/785] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:23 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:21:24.102189 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4c7a2df8-2d0e-4cae-bedc-2835ad3d0cbb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:24.102952 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4c7a2df8-2d0e-4cae-bedc-2835ad3d0cbb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:24.110685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4c7a2df8-2d0e-4cae-bedc-2835ad3d0cbb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:24.111143 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4c7a2df8-2d0e-4cae-bedc-2835ad3d0cbb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:24.111910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4c7a2df8-2d0e-4cae-bedc-2835ad3d0cbb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:24.112345 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4c7a2df8-2d0e-4cae-bedc-2835ad3d0cbb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:24.125410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0717a34c-908a-4783-a916-7214c0f4d4fe tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:24.126338 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0717a34c-908a-4783-a916-7214c0f4d4fe tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:24.133682 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0717a34c-908a-4783-a916-7214c0f4d4fe tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:24.134251 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0717a34c-908a-4783-a916-7214c0f4d4fe tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:24.135791 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0717a34c-908a-4783-a916-7214c0f4d4fe tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:24.136330 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0717a34c-908a-4783-a916-7214c0f4d4fe tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:24.257235 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4c7a2df8-2d0e-4cae-bedc-2835ad3d0cbb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:24.266340 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4c7a2df8-2d0e-4cae-bedc-2835ad3d0cbb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1578 microversion: 2.1 time: 0.173339 Jun 21 08:21:24.266962 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 426/786] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:24 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:24.324371 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0717a34c-908a-4783-a916-7214c0f4d4fe tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:24.331790 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0717a34c-908a-4783-a916-7214c0f4d4fe tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1682 microversion: 2.1 time: 0.210239 Jun 21 08:21:24.332354 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 361/787] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:24 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:21:24.679975 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-215e5c12-dd25-4bd3-aae7-60581832cae6 req-bdd45758-1ea6-4c20-a3d3-655398b33b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed508fef-cc9b-42c9-b954-0e52c65a1d12", "name": "network-vif-deleted", "tag": "d6dff98b-1192-424a-9a7e-a012cd149f34"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:24.688418 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-215e5c12-dd25-4bd3-aae7-60581832cae6 req-bdd45758-1ea6-4c20-a3d3-655398b33b00 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:24.688864 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-215e5c12-dd25-4bd3-aae7-60581832cae6 req-bdd45758-1ea6-4c20-a3d3-655398b33b00 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:24.699824 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-215e5c12-dd25-4bd3-aae7-60581832cae6 req-bdd45758-1ea6-4c20-a3d3-655398b33b00 service nova] Creating event network-vif-deleted:d6dff98b-1192-424a-9a7e-a012cd149f34 for instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 on hv-cinder-83697 Jun 21 08:21:24.704834 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-215e5c12-dd25-4bd3-aae7-60581832cae6 req-bdd45758-1ea6-4c20-a3d3-655398b33b00 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028501 Jun 21 08:21:24.705432 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 427/788] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:25.106864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-95d55da5-fc41-4c0f-bddf-1ae99e95fd77 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:25.107527 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-95d55da5-fc41-4c0f-bddf-1ae99e95fd77 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:25.113754 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-95d55da5-fc41-4c0f-bddf-1ae99e95fd77 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:25.114461 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-95d55da5-fc41-4c0f-bddf-1ae99e95fd77 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:25.115258 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-95d55da5-fc41-4c0f-bddf-1ae99e95fd77 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:25.115685 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-95d55da5-fc41-4c0f-bddf-1ae99e95fd77 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:25.240681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-ac27a115-e0b0-4d34-8196-0fae8c2f2e4f req-8432aa2c-5e16-47cd-a79a-a89a3c9ca222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d983b34e-0d69-4afd-9bb6-f13213be6bb1", "name": "network-vif-unplugged", "status": "completed", "tag": "db75733d-f744-4c74-924b-254ed8090967"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:25.250298 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-ac27a115-e0b0-4d34-8196-0fae8c2f2e4f req-8432aa2c-5e16-47cd-a79a-a89a3c9ca222 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:25.251005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-ac27a115-e0b0-4d34-8196-0fae8c2f2e4f req-8432aa2c-5e16-47cd-a79a-a89a3c9ca222 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:25.257282 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-95d55da5-fc41-4c0f-bddf-1ae99e95fd77 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:25.262486 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-ac27a115-e0b0-4d34-8196-0fae8c2f2e4f req-8432aa2c-5e16-47cd-a79a-a89a3c9ca222 service nova] Creating event network-vif-unplugged:db75733d-f744-4c74-924b-254ed8090967 for instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 on hv-cinder-83697 Jun 21 08:21:25.266585 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-95d55da5-fc41-4c0f-bddf-1ae99e95fd77 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:25.267333 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-ac27a115-e0b0-4d34-8196-0fae8c2f2e4f req-8432aa2c-5e16-47cd-a79a-a89a3c9ca222 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030648 Jun 21 08:21:25.267924 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 428/789] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:21:25.268131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-95d55da5-fc41-4c0f-bddf-1ae99e95fd77 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:25.269351 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-95d55da5-fc41-4c0f-bddf-1ae99e95fd77 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1600 microversion: 2.20 time: 0.167778 Jun 21 08:21:25.269903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 362/790] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:21:25 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:21:25.283662 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9e58cf85-fa2e-4290-831d-2ca3efdbc28c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:25.284666 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9e58cf85-fa2e-4290-831d-2ca3efdbc28c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:25.289068 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a3cd64ae-65f0-476f-86c6-0bf9bfff224e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:25.289564 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a3cd64ae-65f0-476f-86c6-0bf9bfff224e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:25.291157 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9e58cf85-fa2e-4290-831d-2ca3efdbc28c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:25.292268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9e58cf85-fa2e-4290-831d-2ca3efdbc28c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:25.293053 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9e58cf85-fa2e-4290-831d-2ca3efdbc28c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:25.293660 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9e58cf85-fa2e-4290-831d-2ca3efdbc28c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:25.297214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a3cd64ae-65f0-476f-86c6-0bf9bfff224e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:25.297663 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a3cd64ae-65f0-476f-86c6-0bf9bfff224e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:25.298481 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a3cd64ae-65f0-476f-86c6-0bf9bfff224e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:25.298951 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a3cd64ae-65f0-476f-86c6-0bf9bfff224e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:25.303140 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:25.397853 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a3cd64ae-65f0-476f-86c6-0bf9bfff224e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.112597 Jun 21 08:21:25.398666 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 363/791] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Jun 21 08:21:25 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 08:21:25.409933 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:25.410561 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:25.422441 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:25.424148 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:25.425197 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:25.425836 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:25.461317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9e58cf85-fa2e-4290-831d-2ca3efdbc28c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:25.471147 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9e58cf85-fa2e-4290-831d-2ca3efdbc28c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1578 microversion: 2.1 time: 0.191460 Jun 21 08:21:25.472350 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 429/792] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:25 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:21:25.475800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:25.476475 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:25.477372 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lazy-loading 'fault' on Instance uuid ed508fef-cc9b-42c9-b954-0e52c65a1d12 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:21:25.546935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0dccd8f960443894a99baa79198005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a4467fae7e4bdea5a1e00c0379c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:25.555009 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c636a2a5-7b25-4896-808f-89783b450d58 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 200 len: 1332 microversion: 2.1 time: 0.151257 Jun 21 08:21:25.555680 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 364/793] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:25 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 1332 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:26.488963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f6095e75-1f38-4401-8549-7aa60efe195a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:26.489565 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f6095e75-1f38-4401-8549-7aa60efe195a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:26.496771 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f6095e75-1f38-4401-8549-7aa60efe195a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:26.497267 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f6095e75-1f38-4401-8549-7aa60efe195a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:26.498027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f6095e75-1f38-4401-8549-7aa60efe195a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:26.498453 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f6095e75-1f38-4401-8549-7aa60efe195a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:26.572758 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-30c1763d-da95-44e5-9f3c-d7929899b3e2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:26.573945 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-30c1763d-da95-44e5-9f3c-d7929899b3e2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:26.586987 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-30c1763d-da95-44e5-9f3c-d7929899b3e2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:26.587439 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-30c1763d-da95-44e5-9f3c-d7929899b3e2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:26.588240 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-30c1763d-da95-44e5-9f3c-d7929899b3e2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:26.589261 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-30c1763d-da95-44e5-9f3c-d7929899b3e2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:26.602951 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-30c1763d-da95-44e5-9f3c-d7929899b3e2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-30c1763d-da95-44e5-9f3c-d7929899b3e2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 HTTP/1.1 Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:21:26.606334 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:26.607747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'ed508fef-cc9b-42c9-b954-0e52c65a1d12'} Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:21:26.608543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:26.609789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:26.610941 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-30c1763d-da95-44e5-9f3c-d7929899b3e2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:21:26.610941 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-30c1763d-da95-44e5-9f3c-d7929899b3e2 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 404 len: 111 microversion: 2.1 time: 0.039108 Jun 21 08:21:26.610941 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 365/794] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:26 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 08:21:26.617303 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-187abb47-ff91-454e-bd81-25173823f1e1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '.version_select at 0x7fded2ca1ee0>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:26.639157 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f6095e75-1f38-4401-8549-7aa60efe195a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:26.639448 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-187abb47-ff91-454e-bd81-25173823f1e1 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292803965" status: 202 len: 0 microversion: 2.1 time: 0.026145 Jun 21 08:21:26.640026 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 366/795] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jun 21 08:21:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292803965 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 08:21:26.648213 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f6095e75-1f38-4401-8549-7aa60efe195a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1578 microversion: 2.1 time: 0.163255 Jun 21 08:21:26.648886 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 430/796] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:26 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:26.722522 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-04d99fb4-716b-4bd7-8942-69d9332adb25 req-4c4a72e9-0a08-4117-b83d-299a3290891f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c679db4c-d2f2-4b89-8027-39078f9bf5aa", "tag": "cf45f811-be66-426a-b1e5-e7bddc45e9f0"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:26.734486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-04d99fb4-716b-4bd7-8942-69d9332adb25 req-4c4a72e9-0a08-4117-b83d-299a3290891f service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:26.735263 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-04d99fb4-716b-4bd7-8942-69d9332adb25 req-4c4a72e9-0a08-4117-b83d-299a3290891f service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:26.748227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-04d99fb4-716b-4bd7-8942-69d9332adb25 req-4c4a72e9-0a08-4117-b83d-299a3290891f service nova] Creating event network-changed:cf45f811-be66-426a-b1e5-e7bddc45e9f0 for instance c679db4c-d2f2-4b89-8027-39078f9bf5aa on hv-cinder-83697 Jun 21 08:21:26.753593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-04d99fb4-716b-4bd7-8942-69d9332adb25 req-4c4a72e9-0a08-4117-b83d-299a3290891f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034839 Jun 21 08:21:26.754278 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 367/797] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:27.665275 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e40bdaf4-c9b5-4218-9c25-65f2552f3f5b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:27.665891 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e40bdaf4-c9b5-4218-9c25-65f2552f3f5b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:27.669372 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:27.674572 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e40bdaf4-c9b5-4218-9c25-65f2552f3f5b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:27.675093 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e40bdaf4-c9b5-4218-9c25-65f2552f3f5b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:27.675850 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e40bdaf4-c9b5-4218-9c25-65f2552f3f5b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:27.676298 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e40bdaf4-c9b5-4218-9c25-65f2552f3f5b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:27.816429 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e40bdaf4-c9b5-4218-9c25-65f2552f3f5b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:27.824317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e40bdaf4-c9b5-4218-9c25-65f2552f3f5b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1578 microversion: 2.1 time: 0.162922 Jun 21 08:21:27.825170 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 431/798] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:27 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:28.428979 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d31a2c49-e782-431a-a0d2-b753e54e2376 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:28.429554 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d31a2c49-e782-431a-a0d2-b753e54e2376 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:28.435792 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d31a2c49-e782-431a-a0d2-b753e54e2376 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:28.436236 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d31a2c49-e782-431a-a0d2-b753e54e2376 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:28.436983 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d31a2c49-e782-431a-a0d2-b753e54e2376 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:28.437413 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d31a2c49-e782-431a-a0d2-b753e54e2376 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:28.458884 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-d31a2c49-e782-431a-a0d2-b753e54e2376 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d31a2c49-e782-431a-a0d2-b753e54e2376 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: DELETE /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 HTTP/1.1 Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:21:28.460602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:28.462232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'ed508fef-cc9b-42c9-b954-0e52c65a1d12'} Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:21:28.463777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:28.465267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:28.466743 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d31a2c49-e782-431a-a0d2-b753e54e2376 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:21:28.466743 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d31a2c49-e782-431a-a0d2-b753e54e2376 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 404 len: 111 microversion: 2.1 time: 0.040301 Jun 21 08:21:28.466743 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 368/799] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:21:28 2022] DELETE /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:21:28.475487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-122da3a9-600d-4fbe-97c8-684afeeab9fa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:28.476621 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-122da3a9-600d-4fbe-97c8-684afeeab9fa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: ed508fef-cc9b-42c9-b954-0e52c65a1d12] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:28.484636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-122da3a9-600d-4fbe-97c8-684afeeab9fa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:28.485092 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-122da3a9-600d-4fbe-97c8-684afeeab9fa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:28.485867 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-122da3a9-600d-4fbe-97c8-684afeeab9fa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:28.486308 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-122da3a9-600d-4fbe-97c8-684afeeab9fa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:28.499662 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-122da3a9-600d-4fbe-97c8-684afeeab9fa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-122da3a9-600d-4fbe-97c8-684afeeab9fa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 HTTP/1.1 Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:21:28.501303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:28.503228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'ed508fef-cc9b-42c9-b954-0e52c65a1d12'} Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:21:28.504681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. Jun 21 08:21:28.506659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:28.508693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-122da3a9-600d-4fbe-97c8-684afeeab9fa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance ed508fef-cc9b-42c9-b954-0e52c65a1d12 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:21:28.508693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-122da3a9-600d-4fbe-97c8-684afeeab9fa tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12" status: 404 len: 111 microversion: 2.1 time: 0.032965 Jun 21 08:21:28.508693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 432/800] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:28 2022] GET /compute/v2.1/servers/ed508fef-cc9b-42c9-b954-0e52c65a1d12 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:21:28.841524 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d2ff464c-062f-4a0d-aab3-6fbb34cf550c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:28.842252 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d2ff464c-062f-4a0d-aab3-6fbb34cf550c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:28.849295 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2ff464c-062f-4a0d-aab3-6fbb34cf550c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:28.849829 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2ff464c-062f-4a0d-aab3-6fbb34cf550c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:28.850598 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2ff464c-062f-4a0d-aab3-6fbb34cf550c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:28.851063 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d2ff464c-062f-4a0d-aab3-6fbb34cf550c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:28.992894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d2ff464c-062f-4a0d-aab3-6fbb34cf550c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:29.001545 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d2ff464c-062f-4a0d-aab3-6fbb34cf550c tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1578 microversion: 2.1 time: 0.164071 Jun 21 08:21:29.002595 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 369/801] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:28 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:29.648271 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dfde2fa9-eb5d-47c2-a915-c23b455640e4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:29.648810 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-dfde2fa9-eb5d-47c2-a915-c23b455640e4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:29.655310 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dfde2fa9-eb5d-47c2-a915-c23b455640e4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:29.655763 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dfde2fa9-eb5d-47c2-a915-c23b455640e4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:29.656525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dfde2fa9-eb5d-47c2-a915-c23b455640e4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:29.656963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dfde2fa9-eb5d-47c2-a915-c23b455640e4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:29.670166 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-dfde2fa9-eb5d-47c2-a915-c23b455640e4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dfde2fa9-eb5d-47c2-a915-c23b455640e4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: DELETE /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 HTTP/1.1 Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:21:29.671715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:21:29.673425 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '74ee7b38-833c-4047-9999-c591d6088b45'} Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:21:29.674234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:21:29.675589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.676854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dfde2fa9-eb5d-47c2-a915-c23b455640e4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:21:29.676854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-dfde2fa9-eb5d-47c2-a915-c23b455640e4 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 404 len: 111 microversion: 2.1 time: 0.028749 Jun 21 08:21:29.676854 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 433/802] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:21:29 2022] DELETE /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:21:29.681597 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-12cad77e-82f7-4e6d-bf1d-4f7c241b32b9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:29.682755 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-12cad77e-82f7-4e6d-bf1d-4f7c241b32b9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 74ee7b38-833c-4047-9999-c591d6088b45] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:29.689226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12cad77e-82f7-4e6d-bf1d-4f7c241b32b9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:29.689669 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12cad77e-82f7-4e6d-bf1d-4f7c241b32b9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:29.690413 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12cad77e-82f7-4e6d-bf1d-4f7c241b32b9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:29.690862 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12cad77e-82f7-4e6d-bf1d-4f7c241b32b9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:29.704280 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-12cad77e-82f7-4e6d-bf1d-4f7c241b32b9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-12cad77e-82f7-4e6d-bf1d-4f7c241b32b9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 HTTP/1.1 Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:21:29.705765 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:21:29.707349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '74ee7b38-833c-4047-9999-c591d6088b45'} Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:21:29.711254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. Jun 21 08:21:29.712668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.713968 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-12cad77e-82f7-4e6d-bf1d-4f7c241b32b9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance 74ee7b38-833c-4047-9999-c591d6088b45 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:21:29.713968 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-12cad77e-82f7-4e6d-bf1d-4f7c241b32b9 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45" status: 404 len: 111 microversion: 2.1 time: 0.029588 Jun 21 08:21:29.713968 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 370/803] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:29 2022] GET /compute/v2.1/servers/74ee7b38-833c-4047-9999-c591d6088b45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:21:29.715692 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-923529be-32ab-45c8-a4c4-49e3ff39981e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:29.716184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-923529be-32ab-45c8-a4c4-49e3ff39981e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:29.722115 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-923529be-32ab-45c8-a4c4-49e3ff39981e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:29.722557 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-923529be-32ab-45c8-a4c4-49e3ff39981e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:29.723334 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-923529be-32ab-45c8-a4c4-49e3ff39981e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:29.723763 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-923529be-32ab-45c8-a4c4-49e3ff39981e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:29.736733 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-923529be-32ab-45c8-a4c4-49e3ff39981e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-923529be-32ab-45c8-a4c4-49e3ff39981e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: DELETE /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa HTTP/1.1 Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:21:29.738172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:21:29.740065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '6909a083-0588-4b06-916a-e9b153960ffa'} Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:21:29.741108 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:21:29.742768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.744207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-923529be-32ab-45c8-a4c4-49e3ff39981e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:21:29.744207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-923529be-32ab-45c8-a4c4-49e3ff39981e tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 404 len: 111 microversion: 2.1 time: 0.027626 Jun 21 08:21:29.744207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 434/804] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:21:29 2022] DELETE /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 08:21:29.748126 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-13acd138-28e8-4599-984a-e67cf5272313 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:29.748729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-13acd138-28e8-4599-984a-e67cf5272313 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 6909a083-0588-4b06-916a-e9b153960ffa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:29.754929 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-13acd138-28e8-4599-984a-e67cf5272313 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:29.755365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-13acd138-28e8-4599-984a-e67cf5272313 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:29.756110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-13acd138-28e8-4599-984a-e67cf5272313 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:29.756537 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-13acd138-28e8-4599-984a-e67cf5272313 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:29.769822 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-13acd138-28e8-4599-984a-e67cf5272313 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-13acd138-28e8-4599-984a-e67cf5272313 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa HTTP/1.1 Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:21:29.771353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:21:29.772898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '6909a083-0588-4b06-916a-e9b153960ffa'} Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:21:29.773856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. Jun 21 08:21:29.775099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:29.776269 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-13acd138-28e8-4599-984a-e67cf5272313 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance 6909a083-0588-4b06-916a-e9b153960ffa could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:21:29.776269 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-13acd138-28e8-4599-984a-e67cf5272313 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa" status: 404 len: 111 microversion: 2.1 time: 0.028763 Jun 21 08:21:29.776269 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 371/805] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:29 2022] GET /compute/v2.1/servers/6909a083-0588-4b06-916a-e9b153960ffa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 08:21:30.019888 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4589b8e0-f84e-4c30-9b35-a90595b331ca tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:30.020470 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4589b8e0-f84e-4c30-9b35-a90595b331ca tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:30.028171 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4589b8e0-f84e-4c30-9b35-a90595b331ca tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:30.028618 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4589b8e0-f84e-4c30-9b35-a90595b331ca tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:30.029421 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4589b8e0-f84e-4c30-9b35-a90595b331ca tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:30.029857 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4589b8e0-f84e-4c30-9b35-a90595b331ca tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:30.165096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4589b8e0-f84e-4c30-9b35-a90595b331ca tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:30.167442 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:30.173893 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4589b8e0-f84e-4c30-9b35-a90595b331ca tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1565 microversion: 2.1 time: 0.158127 Jun 21 08:21:30.174449 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 435/806] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:30 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:30.905929 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6c2a4b6f-1101-4e95-b0f2-4aede33f848d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:30.906446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6c2a4b6f-1101-4e95-b0f2-4aede33f848d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:30.912924 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6c2a4b6f-1101-4e95-b0f2-4aede33f848d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:30.913373 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6c2a4b6f-1101-4e95-b0f2-4aede33f848d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:30.914136 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6c2a4b6f-1101-4e95-b0f2-4aede33f848d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:30.914570 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6c2a4b6f-1101-4e95-b0f2-4aede33f848d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:30.928194 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-6c2a4b6f-1101-4e95-b0f2-4aede33f848d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6c2a4b6f-1101-4e95-b0f2-4aede33f848d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: DELETE /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 HTTP/1.1 Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:21:30.929741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:21:30.931304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '1c08d704-c754-4c7d-b0f4-540ebde6c782'} Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:21:30.932214 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:21:30.933737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:21:30.935306 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6c2a4b6f-1101-4e95-b0f2-4aede33f848d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:21:30.935306 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6c2a4b6f-1101-4e95-b0f2-4aede33f848d tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 404 len: 111 microversion: 2.1 time: 0.029065 Jun 21 08:21:30.935306 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 372/807] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:21:30 2022] DELETE /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:21:30.939942 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1aca8318-a651-43a2-88df-1721d927e871 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:30.940562 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1aca8318-a651-43a2-88df-1721d927e871 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] [instance: 1c08d704-c754-4c7d-b0f4-540ebde6c782] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:30.949006 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1aca8318-a651-43a2-88df-1721d927e871 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:30.949457 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1aca8318-a651-43a2-88df-1721d927e871 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:30.950226 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1aca8318-a651-43a2-88df-1721d927e871 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:30.950706 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1aca8318-a651-43a2-88df-1721d927e871 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:30.964524 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-1aca8318-a651-43a2-88df-1721d927e871 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] HTTP exception thrown: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1aca8318-a651-43a2-88df-1721d927e871 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Request method failure captured: Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 HTTP/1.1 Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX4eX6wpBPMr-lGkML0PZYy8HQL0AqIZorindb6CWaLHiHZvFvQoFM3sTWzNinZTlcmVKa8RAKs1El2c4FsjZalIeVSyCmNetcQ6c7i56xAvb8KAWrXyQ1S9An8eppBiQPpgtQpbgSiyHxxOgNn6JO8ZWAfCHPXK22QYOuK14A4tfO8 Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:21:30.966052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1a4467fae7e4bdea5a1e00c0379c326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1a4467fae7e4bdea5a1e00c0379c326", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: d1a4467fae7e4bdea5a1e00c0379c326 Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2098766872 Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: de0dccd8f960443894a99baa79198005 Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-AttachVolumeNegativeTest-2098766872-project Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:21:30.967650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '1c08d704-c754-4c7d-b0f4-540ebde6c782'} Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:21:30.968582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. Jun 21 08:21:30.970005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:21:30.972555 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1aca8318-a651-43a2-88df-1721d927e871 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] Returning 404 to user: Instance 1c08d704-c754-4c7d-b0f4-540ebde6c782 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:21:30.972555 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1aca8318-a651-43a2-88df-1721d927e871 tempest-AttachVolumeNegativeTest-2098766872 tempest-AttachVolumeNegativeTest-2098766872-project] 10.222.0.36 "GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782" status: 404 len: 111 microversion: 2.1 time: 0.031286 Jun 21 08:21:30.972555 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 436/808] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:30 2022] GET /compute/v2.1/servers/1c08d704-c754-4c7d-b0f4-540ebde6c782 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:21:31.129789 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-e1d6cad2-057a-44d6-81c5-d275ceaefc25 req-ecfac01a-56d6-4782-8fce-1f7f16a2dc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d983b34e-0d69-4afd-9bb6-f13213be6bb1", "name": "network-vif-plugged", "status": "completed", "tag": "db75733d-f744-4c74-924b-254ed8090967"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:31.139348 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-e1d6cad2-057a-44d6-81c5-d275ceaefc25 req-ecfac01a-56d6-4782-8fce-1f7f16a2dc7f service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:31.139760 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-e1d6cad2-057a-44d6-81c5-d275ceaefc25 req-ecfac01a-56d6-4782-8fce-1f7f16a2dc7f service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:31.152590 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-e1d6cad2-057a-44d6-81c5-d275ceaefc25 req-ecfac01a-56d6-4782-8fce-1f7f16a2dc7f service nova] Creating event network-vif-plugged:db75733d-f744-4c74-924b-254ed8090967 for instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 on hv-cinder-83697 Jun 21 08:21:31.157770 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-e1d6cad2-057a-44d6-81c5-d275ceaefc25 req-ecfac01a-56d6-4782-8fce-1f7f16a2dc7f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031682 Jun 21 08:21:31.158381 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 373/809] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:33.906230 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6e6a86e9-ae80-45f3-8387-5c811833cb65 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:33.907037 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6e6a86e9-ae80-45f3-8387-5c811833cb65 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:33.918781 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e6a86e9-ae80-45f3-8387-5c811833cb65 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:33.919271 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e6a86e9-ae80-45f3-8387-5c811833cb65 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:33.920128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e6a86e9-ae80-45f3-8387-5c811833cb65 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:33.920667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6e6a86e9-ae80-45f3-8387-5c811833cb65 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:33.946428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6e6a86e9-ae80-45f3-8387-5c811833cb65 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/ips" status: 200 len: 145 microversion: 2.1 time: 0.044231 Jun 21 08:21:33.947203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 437/810] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 08:21:33 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:35.356790 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-dcd2438a-2cd6-4131-888f-6b1c55fc1d2e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c22f56d1-69d0-4548-aca9-24610e849175"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:35.357967 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-dcd2438a-2cd6-4131-888f-6b1c55fc1d2e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:35.364179 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dcd2438a-2cd6-4131-888f-6b1c55fc1d2e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:35.367433 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dcd2438a-2cd6-4131-888f-6b1c55fc1d2e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:35.367433 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dcd2438a-2cd6-4131-888f-6b1c55fc1d2e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:35.367433 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dcd2438a-2cd6-4131-888f-6b1c55fc1d2e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:35.624653 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-dcd2438a-2cd6-4131-888f-6b1c55fc1d2e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273459 Jun 21 08:21:35.630079 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 374/811] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:21:35 2022] POST /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:42.081174 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-184f9865-9c51-4cac-ab24-3ccd27f378cf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:42.082102 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-184f9865-9c51-4cac-ab24-3ccd27f378cf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:42.088953 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-184f9865-9c51-4cac-ab24-3ccd27f378cf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:42.089404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-184f9865-9c51-4cac-ab24-3ccd27f378cf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:42.090159 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-184f9865-9c51-4cac-ab24-3ccd27f378cf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:42.090587 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-184f9865-9c51-4cac-ab24-3ccd27f378cf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:42.120060 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-184f9865-9c51-4cac-ab24-3ccd27f378cf tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042095 Jun 21 08:21:42.120601 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 438/812] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:21:42 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:42.131887 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0847b6ac-3fb6-4cbd-858b-1f988d6e8023 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:42.132466 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0847b6ac-3fb6-4cbd-858b-1f988d6e8023 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:42.134406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:42.140022 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0847b6ac-3fb6-4cbd-858b-1f988d6e8023 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:42.140467 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0847b6ac-3fb6-4cbd-858b-1f988d6e8023 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:42.141230 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0847b6ac-3fb6-4cbd-858b-1f988d6e8023 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:42.141666 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0847b6ac-3fb6-4cbd-858b-1f988d6e8023 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:42.172475 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0847b6ac-3fb6-4cbd-858b-1f988d6e8023 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments/c22f56d1-69d0-4548-aca9-24610e849175" status: 200 len: 194 microversion: 2.1 time: 0.045876 Jun 21 08:21:42.173049 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 375/813] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jun 21 08:21:42 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments/c22f56d1-69d0-4548-aca9-24610e849175 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:45.579091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-569eba4a-b606-4a89-8c39-0c656a4895bb tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f33e9da8-0601-4d85-82bc-fd408723ea3a"}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:45.580208 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-569eba4a-b606-4a89-8c39-0c656a4895bb tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:45.586814 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-569eba4a-b606-4a89-8c39-0c656a4895bb tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:45.587281 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-569eba4a-b606-4a89-8c39-0c656a4895bb tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:45.588061 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-569eba4a-b606-4a89-8c39-0c656a4895bb tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:45.589588 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-569eba4a-b606-4a89-8c39-0c656a4895bb tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:45.830126 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-569eba4a-b606-4a89-8c39-0c656a4895bb tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "POST /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254968 Jun 21 08:21:45.835342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 439/814] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:21:45 2022] POST /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:53.336283 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c695ef6c-b90a-4644-9c87-3581fabf9698 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:53.337251 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c695ef6c-b90a-4644-9c87-3581fabf9698 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:53.340403 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:53.341045 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:53.347477 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c695ef6c-b90a-4644-9c87-3581fabf9698 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:53.347942 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c695ef6c-b90a-4644-9c87-3581fabf9698 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:53.348720 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c695ef6c-b90a-4644-9c87-3581fabf9698 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:53.349135 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c695ef6c-b90a-4644-9c87-3581fabf9698 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:53.379934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c695ef6c-b90a-4644-9c87-3581fabf9698 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047554 Jun 21 08:21:53.380514 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 376/815] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:21:53 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:53.522841 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-259faa7d-da0f-4b1f-b59e-95e371b6b926 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:53.523579 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-259faa7d-da0f-4b1f-b59e-95e371b6b926 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:53.530074 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-259faa7d-da0f-4b1f-b59e-95e371b6b926 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:53.530532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-259faa7d-da0f-4b1f-b59e-95e371b6b926 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:53.531335 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-259faa7d-da0f-4b1f-b59e-95e371b6b926 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:53.531774 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-259faa7d-da0f-4b1f-b59e-95e371b6b926 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:53.562636 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-259faa7d-da0f-4b1f-b59e-95e371b6b926 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments/c22f56d1-69d0-4548-aca9-24610e849175" status: 200 len: 194 microversion: 2.1 time: 0.044502 Jun 21 08:21:53.563232 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 440/816] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jun 21 08:21:53 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments/c22f56d1-69d0-4548-aca9-24610e849175 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:53.572931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bab21bd8-43f5-4fd0-82c1-2cdf357c8657 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:53.573505 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bab21bd8-43f5-4fd0-82c1-2cdf357c8657 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:53.580979 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bab21bd8-43f5-4fd0-82c1-2cdf357c8657 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:53.581430 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bab21bd8-43f5-4fd0-82c1-2cdf357c8657 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:53.582203 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bab21bd8-43f5-4fd0-82c1-2cdf357c8657 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:53.582656 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bab21bd8-43f5-4fd0-82c1-2cdf357c8657 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:53.665971 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-bab21bd8-43f5-4fd0-82c1-2cdf357c8657 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lazy-loading 'services' on Instance uuid 87aee4df-7232-4331-a685-0c07836cb986 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:21:53.747752 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bab21bd8-43f5-4fd0-82c1-2cdf357c8657 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "DELETE /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments/c22f56d1-69d0-4548-aca9-24610e849175" status: 202 len: 0 microversion: 2.1 time: 0.178400 Jun 21 08:21:53.748537 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 377/817] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:21:53 2022] DELETE /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments/c22f56d1-69d0-4548-aca9-24610e849175 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:21:54.889821 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-589f5ed6-1417-4458-9a1d-f213cf86bc9e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:54.890350 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-589f5ed6-1417-4458-9a1d-f213cf86bc9e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:54.896674 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-589f5ed6-1417-4458-9a1d-f213cf86bc9e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:54.897123 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-589f5ed6-1417-4458-9a1d-f213cf86bc9e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:54.897880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-589f5ed6-1417-4458-9a1d-f213cf86bc9e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:54.898317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-589f5ed6-1417-4458-9a1d-f213cf86bc9e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:54.928397 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-589f5ed6-1417-4458-9a1d-f213cf86bc9e tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments/f33e9da8-0601-4d85-82bc-fd408723ea3a" status: 200 len: 194 microversion: 2.1 time: 0.043286 Jun 21 08:21:54.934542 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 441/818] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jun 21 08:21:54 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments/f33e9da8-0601-4d85-82bc-fd408723ea3a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:21:54.944018 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-88f0484d-656c-4069-bd83-af2b59e27645 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:54.944937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-88f0484d-656c-4069-bd83-af2b59e27645 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:54.953764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88f0484d-656c-4069-bd83-af2b59e27645 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:54.954418 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88f0484d-656c-4069-bd83-af2b59e27645 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:54.955787 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88f0484d-656c-4069-bd83-af2b59e27645 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:54.956399 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88f0484d-656c-4069-bd83-af2b59e27645 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:55.044655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-88f0484d-656c-4069-bd83-af2b59e27645 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lazy-loading 'services' on Instance uuid 87aee4df-7232-4331-a685-0c07836cb986 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:21:55.118726 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-88f0484d-656c-4069-bd83-af2b59e27645 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "DELETE /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments/f33e9da8-0601-4d85-82bc-fd408723ea3a" status: 202 len: 0 microversion: 2.1 time: 0.182858 Jun 21 08:21:55.119307 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 378/819] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:21:54 2022] DELETE /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments/f33e9da8-0601-4d85-82bc-fd408723ea3a => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:21:56.292488 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e750688a-74da-4b46-853c-58f39b1a0c29 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:56.294112 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e750688a-74da-4b46-853c-58f39b1a0c29 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:56.300682 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e750688a-74da-4b46-853c-58f39b1a0c29 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:56.301132 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e750688a-74da-4b46-853c-58f39b1a0c29 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:56.301901 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e750688a-74da-4b46-853c-58f39b1a0c29 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:56.302344 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e750688a-74da-4b46-853c-58f39b1a0c29 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:56.334163 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e750688a-74da-4b46-853c-58f39b1a0c29 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044423 Jun 21 08:21:56.334163 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 442/820] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:21:56 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:21:56.444941 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ec88b3c2-17f7-4111-b6e3-20431059a3b4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:56.446093 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-ec88b3c2-17f7-4111-b6e3-20431059a3b4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:56.454352 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ec88b3c2-17f7-4111-b6e3-20431059a3b4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:56.454896 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ec88b3c2-17f7-4111-b6e3-20431059a3b4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:56.455662 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ec88b3c2-17f7-4111-b6e3-20431059a3b4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:56.456089 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ec88b3c2-17f7-4111-b6e3-20431059a3b4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:56.489103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ec88b3c2-17f7-4111-b6e3-20431059a3b4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048616 Jun 21 08:21:56.489782 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 379/821] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 08:21:56 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 08:21:56.556001 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8be73be9-8ad6-43e2-9517-259270ad3a00 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:56.556948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8be73be9-8ad6-43e2-9517-259270ad3a00 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:56.566083 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8be73be9-8ad6-43e2-9517-259270ad3a00 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:56.566604 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8be73be9-8ad6-43e2-9517-259270ad3a00 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:56.567455 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8be73be9-8ad6-43e2-9517-259270ad3a00 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:56.567900 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8be73be9-8ad6-43e2-9517-259270ad3a00 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:56.607915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8be73be9-8ad6-43e2-9517-259270ad3a00 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Going to try to terminate instance {{(pid=117547) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:21:56.705321 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8be73be9-8ad6-43e2-9517-259270ad3a00 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "DELETE /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 204 len: 0 microversion: 2.1 time: 0.152351 Jun 21 08:21:56.705940 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 443/822] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:21:56 2022] DELETE /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:21:56.714150 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-121f46b1-c063-4868-9018-9bd9dd4974f5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:56.715313 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-121f46b1-c063-4868-9018-9bd9dd4974f5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:56.721830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-121f46b1-c063-4868-9018-9bd9dd4974f5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:56.722278 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-121f46b1-c063-4868-9018-9bd9dd4974f5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:56.723192 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-121f46b1-c063-4868-9018-9bd9dd4974f5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:56.723663 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-121f46b1-c063-4868-9018-9bd9dd4974f5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:56.859678 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-121f46b1-c063-4868-9018-9bd9dd4974f5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:56.867032 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-121f46b1-c063-4868-9018-9bd9dd4974f5 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1674 microversion: 2.1 time: 0.156803 Jun 21 08:21:56.867597 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 380/823] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:56 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:57.884781 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7c268be8-7436-483d-9080-1f05d435f278 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:57.885399 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7c268be8-7436-483d-9080-1f05d435f278 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:57.887995 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:57.893062 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7c268be8-7436-483d-9080-1f05d435f278 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:57.893785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7c268be8-7436-483d-9080-1f05d435f278 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:57.894547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7c268be8-7436-483d-9080-1f05d435f278 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:57.895007 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7c268be8-7436-483d-9080-1f05d435f278 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:58.032792 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7c268be8-7436-483d-9080-1f05d435f278 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:58.040446 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7c268be8-7436-483d-9080-1f05d435f278 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1674 microversion: 2.1 time: 0.159855 Jun 21 08:21:58.041010 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 444/824] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:57 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:59.057743 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f72354d5-95b1-4c21-aa7e-d379d48c8b5d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:21:59.059885 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f72354d5-95b1-4c21-aa7e-d379d48c8b5d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:21:59.066588 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f72354d5-95b1-4c21-aa7e-d379d48c8b5d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:59.067070 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f72354d5-95b1-4c21-aa7e-d379d48c8b5d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:59.067928 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f72354d5-95b1-4c21-aa7e-d379d48c8b5d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:59.068371 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f72354d5-95b1-4c21-aa7e-d379d48c8b5d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:59.265540 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f72354d5-95b1-4c21-aa7e-d379d48c8b5d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:21:59.273761 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f72354d5-95b1-4c21-aa7e-d379d48c8b5d tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1674 microversion: 2.1 time: 0.220292 Jun 21 08:21:59.275266 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 381/825] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:21:59 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1674 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:21:59.876643 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-c42c87d2-6ff8-4e73-a1c4-3804aec123a5 req-508f2816-4811-45cd-883a-78de96e38932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87aee4df-7232-4331-a685-0c07836cb986", "name": "network-vif-deleted", "tag": "0e1b22d6-9bc6-4f54-96b6-0b460eb9ef12"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:21:59.885620 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-c42c87d2-6ff8-4e73-a1c4-3804aec123a5 req-508f2816-4811-45cd-883a-78de96e38932 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:21:59.886110 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-c42c87d2-6ff8-4e73-a1c4-3804aec123a5 req-508f2816-4811-45cd-883a-78de96e38932 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:21:59.897555 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-c42c87d2-6ff8-4e73-a1c4-3804aec123a5 req-508f2816-4811-45cd-883a-78de96e38932 service nova] Creating event network-vif-deleted:0e1b22d6-9bc6-4f54-96b6-0b460eb9ef12 for instance 87aee4df-7232-4331-a685-0c07836cb986 on hv-cinder-83697 Jun 21 08:21:59.902575 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-c42c87d2-6ff8-4e73-a1c4-3804aec123a5 req-508f2816-4811-45cd-883a-78de96e38932 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029291 Jun 21 08:21:59.903327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 445/826] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:00.295843 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b693a57f-8be0-473b-bb3f-81e98d4819ce tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:00.296405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b693a57f-8be0-473b-bb3f-81e98d4819ce tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:00.303109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b693a57f-8be0-473b-bb3f-81e98d4819ce tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:00.303560 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b693a57f-8be0-473b-bb3f-81e98d4819ce tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:00.304339 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b693a57f-8be0-473b-bb3f-81e98d4819ce tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:00.304771 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b693a57f-8be0-473b-bb3f-81e98d4819ce tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:00.376699 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b693a57f-8be0-473b-bb3f-81e98d4819ce tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:00.384432 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b693a57f-8be0-473b-bb3f-81e98d4819ce tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1323 microversion: 2.1 time: 0.093176 Jun 21 08:22:00.385084 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 382/827] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:22:00 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1323 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:22:01.401683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:01.402507 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:01.408724 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:01.409169 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:01.409923 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:01.410388 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:01.413131 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:01.444399 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:01.444841 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:01.445277 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lazy-loading 'fault' on Instance uuid 87aee4df-7232-4331-a685-0c07836cb986 {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:22:01.487445 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c0039007d641c0aedaa781acaa0abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4b18684de44714b4a54442a17720b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:01.495221 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-78f0d7d3-b8bb-4f67-84a2-9f02142f19b9 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 200 len: 1328 microversion: 2.1 time: 0.098222 Jun 21 08:22:01.496383 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 446/828] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:22:01 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:22:02.513814 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-440f0723-d5da-4725-8bfc-db58d13473e7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:02.514420 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-440f0723-d5da-4725-8bfc-db58d13473e7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:02.520851 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-440f0723-d5da-4725-8bfc-db58d13473e7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:02.521290 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-440f0723-d5da-4725-8bfc-db58d13473e7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:02.522069 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-440f0723-d5da-4725-8bfc-db58d13473e7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:02.522501 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-440f0723-d5da-4725-8bfc-db58d13473e7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:02.536916 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-440f0723-d5da-4725-8bfc-db58d13473e7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] HTTP exception thrown: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-440f0723-d5da-4725-8bfc-db58d13473e7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Request method failure captured: Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 HTTP/1.1 Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4iw7wqV_nRnR5IXSM3tRapD_UCQs18DxqupPgStCeDxiSRGIjKQ6RxgmEx45MWQvqgqdeMaH8pVEF-rfWiJn3GDToBrwpMCXVIO7iW_mUjMNlf_joknI1DT5SdMSmKulsUfOkfUKUNSkVtPUgWlNcoSXPhQdJpPNfl8W5H_5GFs-o Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:22:02.537320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c4b18684de44714b4a54442a17720b7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 62c0039007d641c0aedaa781acaa0abe Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:02.539113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '87aee4df-7232-4331-a685-0c07836cb986'} Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:22:02.539998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:02.541574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:02.542999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-440f0723-d5da-4725-8bfc-db58d13473e7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Returning 404 to user: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:22:02.542999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-440f0723-d5da-4725-8bfc-db58d13473e7 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 404 len: 111 microversion: 2.1 time: 0.029320 Jun 21 08:22:02.542999 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 383/829] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:22:02 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:22:02.547471 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8ed6636d-3c65-4133-b7d8-168767cbd4a4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '.version_select at 0x7fded2db9670>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:02.565064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8ed6636d-3c65-4133-b7d8-168767cbd4a4 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266089221" status: 202 len: 0 microversion: 2.1 time: 0.021256 Jun 21 08:22:02.565611 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 447/830] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jun 21 08:22:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266089221 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:22:02.643370 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6c217ba0-6974-4927-898b-8c07302df502 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:02.643870 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6c217ba0-6974-4927-898b-8c07302df502 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:02.649824 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6c217ba0-6974-4927-898b-8c07302df502 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:02.650275 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6c217ba0-6974-4927-898b-8c07302df502 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:02.651070 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6c217ba0-6974-4927-898b-8c07302df502 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:02.651510 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6c217ba0-6974-4927-898b-8c07302df502 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:02.675568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6c217ba0-6974-4927-898b-8c07302df502 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/ips" status: 200 len: 152 microversion: 2.20 time: 0.036181 Jun 21 08:22:02.676227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 384/831] 10.222.0.36 () {60 vars in 1288 bytes} [Tue Jun 21 08:22:02 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:22:04.903400 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-00b96069-8ac4-468d-99f7-3da04cbf7b4b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:22:04.904604 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-00b96069-8ac4-468d-99f7-3da04cbf7b4b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:04.914478 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-00b96069-8ac4-468d-99f7-3da04cbf7b4b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:04.915336 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-00b96069-8ac4-468d-99f7-3da04cbf7b4b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:04.916402 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-00b96069-8ac4-468d-99f7-3da04cbf7b4b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:04.916827 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-00b96069-8ac4-468d-99f7-3da04cbf7b4b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:04.940253 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-00b96069-8ac4-468d-99f7-3da04cbf7b4b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lazy-loading 'flavor' on Instance uuid c679db4c-d2f2-4b89-8027-39078f9bf5aa {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:22:05.201466 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-00b96069-8ac4-468d-99f7-3da04cbf7b4b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "POST /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/action" status: 202 len: 0 microversion: 2.20 time: 0.301920 Jun 21 08:22:05.202679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 448/832] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 21 08:22:04 2022] POST /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 21 08:22:05.210388 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c15f8b16-15f2-4d26-a0ac-6b577566f55d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:05.211089 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c15f8b16-15f2-4d26-a0ac-6b577566f55d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:05.218404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c15f8b16-15f2-4d26-a0ac-6b577566f55d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:05.219100 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c15f8b16-15f2-4d26-a0ac-6b577566f55d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:05.220044 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c15f8b16-15f2-4d26-a0ac-6b577566f55d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:05.220642 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c15f8b16-15f2-4d26-a0ac-6b577566f55d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:05.360963 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c15f8b16-15f2-4d26-a0ac-6b577566f55d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:05.369568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c15f8b16-15f2-4d26-a0ac-6b577566f55d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:05.371808 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c15f8b16-15f2-4d26-a0ac-6b577566f55d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:05.373045 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c15f8b16-15f2-4d26-a0ac-6b577566f55d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.166682 Jun 21 08:22:05.373685 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 385/833] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:05 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:05.734073 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e76d09e1-80a2-4342-b7dc-b9c33a1a9c8f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:05.734700 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e76d09e1-80a2-4342-b7dc-b9c33a1a9c8f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:05.751638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e76d09e1-80a2-4342-b7dc-b9c33a1a9c8f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:05.752080 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e76d09e1-80a2-4342-b7dc-b9c33a1a9c8f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:05.753105 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e76d09e1-80a2-4342-b7dc-b9c33a1a9c8f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:05.753533 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e76d09e1-80a2-4342-b7dc-b9c33a1a9c8f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:05.767451 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-e76d09e1-80a2-4342-b7dc-b9c33a1a9c8f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] HTTP exception thrown: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e76d09e1-80a2-4342-b7dc-b9c33a1a9c8f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Request method failure captured: Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: DELETE /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 HTTP/1.1 Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX4iw7wqV_nRnR5IXSM3tRapD_UCQs18DxqupPgStCeDxiSRGIjKQ6RxgmEx45MWQvqgqdeMaH8pVEF-rfWiJn3GDToBrwpMCXVIO7iW_mUjMNlf_joknI1DT5SdMSmKulsUfOkfUKUNSkVtPUgWlNcoSXPhQdJpPNfl8W5H_5GFs-o Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:22:05.769101 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c4b18684de44714b4a54442a17720b7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 62c0039007d641c0aedaa781acaa0abe Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:05.770530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '87aee4df-7232-4331-a685-0c07836cb986'} Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:22:05.774387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:05.775761 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:05.777639 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e76d09e1-80a2-4342-b7dc-b9c33a1a9c8f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Returning 404 to user: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:22:05.777639 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e76d09e1-80a2-4342-b7dc-b9c33a1a9c8f tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "DELETE /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 404 len: 111 microversion: 2.1 time: 0.041162 Jun 21 08:22:05.777639 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 449/834] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:22:05 2022] DELETE /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:22:05.779602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7aff90cc-22e3-4789-853a-ac0fb5f6e3bd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:05.780215 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-7aff90cc-22e3-4789-853a-ac0fb5f6e3bd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: 87aee4df-7232-4331-a685-0c07836cb986] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:05.786097 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7aff90cc-22e3-4789-853a-ac0fb5f6e3bd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:05.786544 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7aff90cc-22e3-4789-853a-ac0fb5f6e3bd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:05.787353 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7aff90cc-22e3-4789-853a-ac0fb5f6e3bd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:05.787787 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7aff90cc-22e3-4789-853a-ac0fb5f6e3bd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:05.803050 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-7aff90cc-22e3-4789-853a-ac0fb5f6e3bd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] HTTP exception thrown: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7aff90cc-22e3-4789-853a-ac0fb5f6e3bd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Request method failure captured: Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 HTTP/1.1 Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4iw7wqV_nRnR5IXSM3tRapD_UCQs18DxqupPgStCeDxiSRGIjKQ6RxgmEx45MWQvqgqdeMaH8pVEF-rfWiJn3GDToBrwpMCXVIO7iW_mUjMNlf_joknI1DT5SdMSmKulsUfOkfUKUNSkVtPUgWlNcoSXPhQdJpPNfl8W5H_5GFs-o Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:22:05.804735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c4b18684de44714b4a54442a17720b7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 62c0039007d641c0aedaa781acaa0abe Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:05.806107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '87aee4df-7232-4331-a685-0c07836cb986'} Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:22:05.806927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. Jun 21 08:22:05.808950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:05.810035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7aff90cc-22e3-4789-853a-ac0fb5f6e3bd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Returning 404 to user: Instance 87aee4df-7232-4331-a685-0c07836cb986 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:22:05.810035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7aff90cc-22e3-4789-853a-ac0fb5f6e3bd tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986" status: 404 len: 111 microversion: 2.1 time: 0.030939 Jun 21 08:22:05.810035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 386/835] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:22:05 2022] GET /compute/v2.1/servers/87aee4df-7232-4331-a685-0c07836cb986 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 08:22:06.392949 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-466c8fd7-c4a6-4447-9b2d-2ee6da599da2 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:06.393558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-466c8fd7-c4a6-4447-9b2d-2ee6da599da2 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:06.400063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-466c8fd7-c4a6-4447-9b2d-2ee6da599da2 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:06.400501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-466c8fd7-c4a6-4447-9b2d-2ee6da599da2 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:06.401247 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-466c8fd7-c4a6-4447-9b2d-2ee6da599da2 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:06.401676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-466c8fd7-c4a6-4447-9b2d-2ee6da599da2 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:06.530559 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-466c8fd7-c4a6-4447-9b2d-2ee6da599da2 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:06.538741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-466c8fd7-c4a6-4447-9b2d-2ee6da599da2 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:06.540244 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-466c8fd7-c4a6-4447-9b2d-2ee6da599da2 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:06.541428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-466c8fd7-c4a6-4447-9b2d-2ee6da599da2 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.152417 Jun 21 08:22:06.541974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 450/836] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:06 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:06.947434 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-82343278-6add-4e7a-a51f-ac36a2299d80 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:06.947939 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-82343278-6add-4e7a-a51f-ac36a2299d80 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:06.954487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-82343278-6add-4e7a-a51f-ac36a2299d80 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:06.954973 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-82343278-6add-4e7a-a51f-ac36a2299d80 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:06.955732 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-82343278-6add-4e7a-a51f-ac36a2299d80 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:06.956161 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-82343278-6add-4e7a-a51f-ac36a2299d80 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:06.969997 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-82343278-6add-4e7a-a51f-ac36a2299d80 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] HTTP exception thrown: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-82343278-6add-4e7a-a51f-ac36a2299d80 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Request method failure captured: Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: DELETE /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e HTTP/1.1 Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX4iw7wqV_nRnR5IXSM3tRapD_UCQs18DxqupPgStCeDxiSRGIjKQ6RxgmEx45MWQvqgqdeMaH8pVEF-rfWiJn3GDToBrwpMCXVIO7iW_mUjMNlf_joknI1DT5SdMSmKulsUfOkfUKUNSkVtPUgWlNcoSXPhQdJpPNfl8W5H_5GFs-o Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:22:06.971417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c4b18684de44714b4a54442a17720b7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 62c0039007d641c0aedaa781acaa0abe Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:22:06.973034 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'dfb2c496-4e45-441d-839c-09445870d85e'} Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:22:06.974168 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:22:06.975741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:06.977507 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-82343278-6add-4e7a-a51f-ac36a2299d80 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Returning 404 to user: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:22:06.977507 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-82343278-6add-4e7a-a51f-ac36a2299d80 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 404 len: 111 microversion: 2.1 time: 0.029220 Jun 21 08:22:06.977507 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 387/837] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:22:06 2022] DELETE /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:22:06.984052 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8650648d-3fc1-4def-8d0c-9a8f313e5e99 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:06.984669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8650648d-3fc1-4def-8d0c-9a8f313e5e99 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] [instance: dfb2c496-4e45-441d-839c-09445870d85e] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:06.990737 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8650648d-3fc1-4def-8d0c-9a8f313e5e99 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:06.991175 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8650648d-3fc1-4def-8d0c-9a8f313e5e99 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:06.991931 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8650648d-3fc1-4def-8d0c-9a8f313e5e99 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:06.992363 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8650648d-3fc1-4def-8d0c-9a8f313e5e99 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:07.006282 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-8650648d-3fc1-4def-8d0c-9a8f313e5e99 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] HTTP exception thrown: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8650648d-3fc1-4def-8d0c-9a8f313e5e99 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Request method failure captured: Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e HTTP/1.1 Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX4iw7wqV_nRnR5IXSM3tRapD_UCQs18DxqupPgStCeDxiSRGIjKQ6RxgmEx45MWQvqgqdeMaH8pVEF-rfWiJn3GDToBrwpMCXVIO7iW_mUjMNlf_joknI1DT5SdMSmKulsUfOkfUKUNSkVtPUgWlNcoSXPhQdJpPNfl8W5H_5GFs-o Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:22:07.007822 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c4b18684de44714b4a54442a17720b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c4b18684de44714b4a54442a17720b7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 9c4b18684de44714b4a54442a17720b7 Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717720866 Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 62c0039007d641c0aedaa781acaa0abe Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-AttachVolumeTestJSON-1717720866-project Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:22:07.009239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'dfb2c496-4e45-441d-839c-09445870d85e'} Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:22:07.010036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. Jun 21 08:22:07.011887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:07.013174 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8650648d-3fc1-4def-8d0c-9a8f313e5e99 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] Returning 404 to user: Instance dfb2c496-4e45-441d-839c-09445870d85e could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:22:07.013174 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8650648d-3fc1-4def-8d0c-9a8f313e5e99 tempest-AttachVolumeTestJSON-1717720866 tempest-AttachVolumeTestJSON-1717720866-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e" status: 404 len: 111 microversion: 2.1 time: 0.030218 Jun 21 08:22:07.013174 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 451/838] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:22:06 2022] GET /compute/v2.1/servers/dfb2c496-4e45-441d-839c-09445870d85e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:22:07.559748 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8f6817b8-f870-44c1-8c2a-c1e1f89c309e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:07.560530 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8f6817b8-f870-44c1-8c2a-c1e1f89c309e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:07.566719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8f6817b8-f870-44c1-8c2a-c1e1f89c309e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:07.567444 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8f6817b8-f870-44c1-8c2a-c1e1f89c309e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:07.569406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8f6817b8-f870-44c1-8c2a-c1e1f89c309e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:07.570078 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8f6817b8-f870-44c1-8c2a-c1e1f89c309e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:07.713874 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8f6817b8-f870-44c1-8c2a-c1e1f89c309e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:07.723135 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8f6817b8-f870-44c1-8c2a-c1e1f89c309e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:07.724668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8f6817b8-f870-44c1-8c2a-c1e1f89c309e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:07.725937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8f6817b8-f870-44c1-8c2a-c1e1f89c309e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.170231 Jun 21 08:22:07.726432 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 388/839] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:07 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:08.746564 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-920e43d1-0d40-4333-a3f3-5b9ce4b142ef tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:08.747988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-920e43d1-0d40-4333-a3f3-5b9ce4b142ef tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:08.756084 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-920e43d1-0d40-4333-a3f3-5b9ce4b142ef tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:08.756667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-920e43d1-0d40-4333-a3f3-5b9ce4b142ef tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:08.757663 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-920e43d1-0d40-4333-a3f3-5b9ce4b142ef tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:08.758105 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-920e43d1-0d40-4333-a3f3-5b9ce4b142ef tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:09.009179 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-920e43d1-0d40-4333-a3f3-5b9ce4b142ef tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:09.022368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-920e43d1-0d40-4333-a3f3-5b9ce4b142ef tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:09.025657 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-920e43d1-0d40-4333-a3f3-5b9ce4b142ef tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:09.027813 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-920e43d1-0d40-4333-a3f3-5b9ce4b142ef tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.286798 Jun 21 08:22:09.028626 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 452/840] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:08 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:10.051007 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1939f057-9405-4ca4-b940-88b486d6061d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:10.051772 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1939f057-9405-4ca4-b940-88b486d6061d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:10.072954 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1939f057-9405-4ca4-b940-88b486d6061d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:10.073406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1939f057-9405-4ca4-b940-88b486d6061d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:10.074851 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1939f057-9405-4ca4-b940-88b486d6061d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:10.081109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1939f057-9405-4ca4-b940-88b486d6061d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:10.353661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1939f057-9405-4ca4-b940-88b486d6061d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:10.397026 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1939f057-9405-4ca4-b940-88b486d6061d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:10.399125 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-1939f057-9405-4ca4-b940-88b486d6061d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:10.401078 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1939f057-9405-4ca4-b940-88b486d6061d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.355822 Jun 21 08:22:10.403879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 389/841] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:10 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:11.420335 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-26202739-95cc-4bfc-9528-65b109b19d85 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:11.420945 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-26202739-95cc-4bfc-9528-65b109b19d85 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:11.427113 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-26202739-95cc-4bfc-9528-65b109b19d85 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:11.427577 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-26202739-95cc-4bfc-9528-65b109b19d85 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:11.428325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-26202739-95cc-4bfc-9528-65b109b19d85 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:11.428753 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-26202739-95cc-4bfc-9528-65b109b19d85 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:11.563585 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-26202739-95cc-4bfc-9528-65b109b19d85 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:11.576335 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-26202739-95cc-4bfc-9528-65b109b19d85 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:11.579027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-26202739-95cc-4bfc-9528-65b109b19d85 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:11.580947 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-26202739-95cc-4bfc-9528-65b109b19d85 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.164205 Jun 21 08:22:11.581909 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 453/842] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:11 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:11.732327 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-25d750dc-86ca-4430-91f6-5476fd9a2c23 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Action: 'create', calling method: .version_select at 0x7fded2c42280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-851820485"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:22:12.037289 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-25d750dc-86ca-4430-91f6-5476fd9a2c23 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.422804 Jun 21 08:22:12.038023 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 390/843] 10.222.0.36 () {60 vars in 1154 bytes} [Tue Jun 21 08:22:11 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 424 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 08:22:12.050508 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6131da1c-bce5-49b0-86e6-496437544f19 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2eb5c10>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:12.109724 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6131da1c-bce5-49b0-86e6-496437544f19 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a" status: 200 len: 344 microversion: 2.1 time: 0.063542 Jun 21 08:22:12.110355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 454/844] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:22:12 2022] GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:12.599235 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ba6f3d0e-9ce9-4fce-b404-fe704745705b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:12.599791 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-ba6f3d0e-9ce9-4fce-b404-fe704745705b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:12.606450 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ba6f3d0e-9ce9-4fce-b404-fe704745705b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:12.606926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ba6f3d0e-9ce9-4fce-b404-fe704745705b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:12.607724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ba6f3d0e-9ce9-4fce-b404-fe704745705b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:12.608161 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-ba6f3d0e-9ce9-4fce-b404-fe704745705b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:12.736131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-ba6f3d0e-9ce9-4fce-b404-fe704745705b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:12.744000 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-ba6f3d0e-9ce9-4fce-b404-fe704745705b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:12.745518 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-ba6f3d0e-9ce9-4fce-b404-fe704745705b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:12.746698 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ba6f3d0e-9ce9-4fce-b404-fe704745705b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.151454 Jun 21 08:22:12.747261 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 391/845] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:12 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:13.122582 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0373dd79-b46e-418f-bfa3-d1b57a568ba6 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2d9cee0>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:13.170632 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0373dd79-b46e-418f-bfa3-d1b57a568ba6 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a" status: 200 len: 345 microversion: 2.1 time: 0.051617 Jun 21 08:22:13.171621 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 455/846] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:22:13 2022] GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:13.182508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-574d81e8-4f73-4490-8505-802493433d68 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Action: 'create', calling method: .version_select at 0x7fded2d2eee0>, body: {"snapshot": {"volume_id": "bad13a14-f6da-4368-bbfb-34e9eff4f57a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-872027009"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:22:13.334227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-574d81e8-4f73-4490-8505-802493433d68 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.155395 Jun 21 08:22:13.334867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 392/847] 10.222.0.36 () {60 vars in 1161 bytes} [Tue Jun 21 08:22:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:13.346234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a40eeb89-316a-45cb-b41a-7983fccaa4b5 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2d63550>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:13.392769 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a40eeb89-316a-45cb-b41a-7983fccaa4b5 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e" status: 200 len: 286 microversion: 2.1 time: 0.051821 Jun 21 08:22:13.393343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 456/848] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 08:22:13 2022] GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:13.402988 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9a1f7ebe-0df3-4a68-915d-8da0a2ffa986 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2cd3670>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:13.432558 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9a1f7ebe-0df3-4a68-915d-8da0a2ffa986 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033227 Jun 21 08:22:13.433134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 393/849] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Jun 21 08:22:13 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:13.445926 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-2fb2fca8-833e-4e77-9933-2338911f7ae4 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2dde670>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:13.475511 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-2fb2fca8-833e-4e77-9933-2338911f7ae4 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e" status: 200 len: 286 microversion: 2.1 time: 0.033661 Jun 21 08:22:13.476167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 457/850] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 08:22:13 2022] GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:13.765447 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6a6e0ff9-e93e-4518-b481-98ab0b1436ea tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:13.766057 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6a6e0ff9-e93e-4518-b481-98ab0b1436ea tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:13.775553 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6a6e0ff9-e93e-4518-b481-98ab0b1436ea tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:13.776035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6a6e0ff9-e93e-4518-b481-98ab0b1436ea tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:13.777618 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6a6e0ff9-e93e-4518-b481-98ab0b1436ea tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:13.778058 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6a6e0ff9-e93e-4518-b481-98ab0b1436ea tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:13.934131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6a6e0ff9-e93e-4518-b481-98ab0b1436ea tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:13.944724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6a6e0ff9-e93e-4518-b481-98ab0b1436ea tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:13.946305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6a6e0ff9-e93e-4518-b481-98ab0b1436ea tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:13.947565 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6a6e0ff9-e93e-4518-b481-98ab0b1436ea tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.187131 Jun 21 08:22:13.948113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 394/851] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:13 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:14.487676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-eaaaa1a4-fd6a-43c6-8f77-68b6f5dd104c tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded80ec4c0>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:14.517094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-eaaaa1a4-fd6a-43c6-8f77-68b6f5dd104c tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e" status: 200 len: 286 microversion: 2.1 time: 0.033639 Jun 21 08:22:14.517645 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 458/852] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 08:22:14 2022] GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:14.966513 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-96425ae9-2bc0-4ac1-8939-9f5ec181b8bd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:14.967719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-96425ae9-2bc0-4ac1-8939-9f5ec181b8bd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:14.974045 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-96425ae9-2bc0-4ac1-8939-9f5ec181b8bd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:14.974502 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-96425ae9-2bc0-4ac1-8939-9f5ec181b8bd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:14.975267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-96425ae9-2bc0-4ac1-8939-9f5ec181b8bd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:14.975689 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-96425ae9-2bc0-4ac1-8939-9f5ec181b8bd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:15.106838 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-96425ae9-2bc0-4ac1-8939-9f5ec181b8bd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:15.114701 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-96425ae9-2bc0-4ac1-8939-9f5ec181b8bd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:15.116192 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-96425ae9-2bc0-4ac1-8939-9f5ec181b8bd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:15.117328 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-96425ae9-2bc0-4ac1-8939-9f5ec181b8bd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.154750 Jun 21 08:22:15.117883 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 395/853] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:14 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:15.528703 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-996de903-7ab8-412a-8842-7e4917f6bcb0 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2db9d30>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:15.558103 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-996de903-7ab8-412a-8842-7e4917f6bcb0 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e" status: 200 len: 286 microversion: 2.1 time: 0.033681 Jun 21 08:22:15.558689 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 459/854] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 08:22:15 2022] GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:22:16.136325 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6358901d-6d3b-46f5-a3fc-d5a065ce92c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:16.136946 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6358901d-6d3b-46f5-a3fc-d5a065ce92c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:16.144170 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6358901d-6d3b-46f5-a3fc-d5a065ce92c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:16.144609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6358901d-6d3b-46f5-a3fc-d5a065ce92c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:16.145357 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6358901d-6d3b-46f5-a3fc-d5a065ce92c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:16.145784 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6358901d-6d3b-46f5-a3fc-d5a065ce92c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:16.163169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:16.272942 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6358901d-6d3b-46f5-a3fc-d5a065ce92c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:16.280823 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6358901d-6d3b-46f5-a3fc-d5a065ce92c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:16.282307 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-6358901d-6d3b-46f5-a3fc-d5a065ce92c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:16.283490 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6358901d-6d3b-46f5-a3fc-d5a065ce92c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.151103 Jun 21 08:22:16.284041 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 396/855] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:16 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:16.571914 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9468223e-ebbd-4b3e-8019-ea3d962ace45 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2d9c430>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:16.601143 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9468223e-ebbd-4b3e-8019-ea3d962ace45 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e" status: 200 len: 287 microversion: 2.1 time: 0.033719 Jun 21 08:22:16.601764 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 460/856] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 08:22:16 2022] GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:16.612252 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b480055f-c015-49d4-911f-70edae00063b tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2d2e940>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:16.670715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b480055f-c015-49d4-911f-70edae00063b tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e" status: 202 len: 0 microversion: 2.1 time: 0.061492 Jun 21 08:22:16.671618 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 397/857] 10.222.0.36 () {58 vars in 1253 bytes} [Tue Jun 21 08:22:16 2022] DELETE /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:22:16.679793 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8635874b-e058-416c-9f2c-782b082d022f tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2db9d30>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:16.685028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:22:16.685207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Tue Jun 21 08:22:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:22:16.708852 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8635874b-e058-416c-9f2c-782b082d022f tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e" status: 200 len: 286 microversion: 2.1 time: 0.032785 Jun 21 08:22:16.709407 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 461/858] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 08:22:16 2022] GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:17.302206 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4db22b70-ce4e-48c8-999f-b7b94e3538a3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:17.302829 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4db22b70-ce4e-48c8-999f-b7b94e3538a3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:17.309268 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4db22b70-ce4e-48c8-999f-b7b94e3538a3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:17.309709 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4db22b70-ce4e-48c8-999f-b7b94e3538a3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:17.311150 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4db22b70-ce4e-48c8-999f-b7b94e3538a3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:17.311590 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4db22b70-ce4e-48c8-999f-b7b94e3538a3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:17.446944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4db22b70-ce4e-48c8-999f-b7b94e3538a3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:17.456665 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4db22b70-ce4e-48c8-999f-b7b94e3538a3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:17.458349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4db22b70-ce4e-48c8-999f-b7b94e3538a3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:17.459509 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4db22b70-ce4e-48c8-999f-b7b94e3538a3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1745 microversion: 2.20 time: 0.161810 Jun 21 08:22:17.460089 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 398/859] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:17 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:17.720594 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7ca73c97-4601-484e-ae34-1ff97810fd02 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2eadb80>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:17.745309 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-7ca73c97-4601-484e-ae34-1ff97810fd02 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] HTTP exception thrown: Snapshot e69f35df-0863-4a48-9bf4-4c1d2149707e could not be found. Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7ca73c97-4601-484e-ae34-1ff97810fd02 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Request method failure captured: Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e HTTP/1.1 Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX-zC8xQ0AKpiQc4f0wJPd_B1LssWkfT1bSDYBxujrQ4UcsjGft94EsliRtXOlCT0H6-fthZEN83rZb5yBK5ilEZ8iQgKZ0vT2DbvOFv9Er4Rt09_IJ4xkBcxDIAjhhFGVvawxb6p6Kv0BSa79bJGyaTF4NY88ybj4_SPvrIynwqeZE Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 1b8d0602a7cb4af5b8da1bb7edb83fa6 Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:22:17.747509 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1b8d0602a7cb4af5b8da1bb7edb83fa6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 1b8d0602a7cb4af5b8da1bb7edb83fa6 Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-VolumesSnapshotsTestJSON-2103613737-project Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: b08a3dd720cf45ffaca3a013dff8db4f Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2103613737-project Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Snapshot e69f35df-0863-4a48-9bf4-4c1d2149707e could not be found. Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'e69f35df-0863-4a48-9bf4-4c1d2149707e'} Jun 21 08:22:17.750268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e69f35df-0863-4a48-9bf4-4c1d2149707e could not be found. (HTTP 404) (Request-ID: req-a7b5755f-bfb2-4605-9812-f32537898f63) Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:17.751390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 08:22:17.753064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e69f35df-0863-4a48-9bf4-4c1d2149707e could not be found. Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 21 08:22:17.754691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e69f35df-0863-4a48-9bf4-4c1d2149707e could not be found. Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e69f35df-0863-4a48-9bf4-4c1d2149707e could not be found. Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7ca73c97-4601-484e-ae34-1ff97810fd02 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Returning 404 to user: Snapshot e69f35df-0863-4a48-9bf4-4c1d2149707e could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:22:17.756203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7ca73c97-4601-484e-ae34-1ff97810fd02 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e" status: 404 len: 111 microversion: 2.1 time: 0.033173 Jun 21 08:22:17.757207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 462/860] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 08:22:17 2022] GET /compute/v2.1/os-snapshots/e69f35df-0863-4a48-9bf4-4c1d2149707e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:22:17.759061 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9449325a-dbdf-44d8-8cad-4b105b7710ec tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2c60550>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:17.818207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9449325a-dbdf-44d8-8cad-4b105b7710ec tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a" status: 202 len: 0 microversion: 2.1 time: 0.062800 Jun 21 08:22:17.818801 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 399/861] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 08:22:17 2022] DELETE /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:22:17.827928 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9ee2f7d3-25b0-4a49-a458-bc784a1a11e3 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded80ec310>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:17.874471 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9ee2f7d3-25b0-4a49-a458-bc784a1a11e3 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a" status: 200 len: 344 microversion: 2.1 time: 0.051117 Jun 21 08:22:17.875055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 463/862] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:22:17 2022] GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:18.477997 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c0b06ce9-62a2-4efd-b17e-b5b63dc9e042 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:18.478638 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c0b06ce9-62a2-4efd-b17e-b5b63dc9e042 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:18.484711 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c0b06ce9-62a2-4efd-b17e-b5b63dc9e042 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:18.485163 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c0b06ce9-62a2-4efd-b17e-b5b63dc9e042 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:18.485934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c0b06ce9-62a2-4efd-b17e-b5b63dc9e042 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:18.486369 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c0b06ce9-62a2-4efd-b17e-b5b63dc9e042 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:18.625887 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c0b06ce9-62a2-4efd-b17e-b5b63dc9e042 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:18.635054 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c0b06ce9-62a2-4efd-b17e-b5b63dc9e042 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:18.636639 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c0b06ce9-62a2-4efd-b17e-b5b63dc9e042 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:18.637834 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c0b06ce9-62a2-4efd-b17e-b5b63dc9e042 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1740 microversion: 2.20 time: 0.164208 Jun 21 08:22:18.639125 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 400/863] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:18 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:18.887990 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-621d42c0-54a9-4057-8ee8-655a5af1c26d tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2eee670>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:18.921148 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-621d42c0-54a9-4057-8ee8-655a5af1c26d tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] HTTP exception thrown: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-621d42c0-54a9-4057-8ee8-655a5af1c26d tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Request method failure captured: Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a HTTP/1.1 Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX-zC8xQ0AKpiQc4f0wJPd_B1LssWkfT1bSDYBxujrQ4UcsjGft94EsliRtXOlCT0H6-fthZEN83rZb5yBK5ilEZ8iQgKZ0vT2DbvOFv9Er4Rt09_IJ4xkBcxDIAjhhFGVvawxb6p6Kv0BSa79bJGyaTF4NY88ybj4_SPvrIynwqeZE Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 1b8d0602a7cb4af5b8da1bb7edb83fa6 Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:22:18.923128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1b8d0602a7cb4af5b8da1bb7edb83fa6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 1b8d0602a7cb4af5b8da1bb7edb83fa6 Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-VolumesSnapshotsTestJSON-2103613737-project Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: b08a3dd720cf45ffaca3a013dff8db4f Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2103613737-project Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'bad13a14-f6da-4368-bbfb-34e9eff4f57a'} Jun 21 08:22:18.925107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. (HTTP 404) (Request-ID: req-4a6dd2b9-8483-49a7-acbb-fb31b5c42ab4) Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:18.926390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 08:22:18.927927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 08:22:18.929401 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:18.930918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.933055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-621d42c0-54a9-4057-8ee8-655a5af1c26d tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Returning 404 to user: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:22:18.934076 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-621d42c0-54a9-4057-8ee8-655a5af1c26d tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a" status: 404 len: 109 microversion: 2.1 time: 0.050724 Jun 21 08:22:18.944553 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 464/864] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:22:18 2022] GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:22:18.949692 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7c734071-14dc-4fb1-b254-3547b8961178 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2c60ca0>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:18.979714 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-7c734071-14dc-4fb1-b254-3547b8961178 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] HTTP exception thrown: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7c734071-14dc-4fb1-b254-3547b8961178 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Request method failure captured: Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: DELETE /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a HTTP/1.1 Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX-zC8xQ0AKpiQc4f0wJPd_B1LssWkfT1bSDYBxujrQ4UcsjGft94EsliRtXOlCT0H6-fthZEN83rZb5yBK5ilEZ8iQgKZ0vT2DbvOFv9Er4Rt09_IJ4xkBcxDIAjhhFGVvawxb6p6Kv0BSa79bJGyaTF4NY88ybj4_SPvrIynwqeZE Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: 1b8d0602a7cb4af5b8da1bb7edb83fa6 Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:22:18.981645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1b8d0602a7cb4af5b8da1bb7edb83fa6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: 1b8d0602a7cb4af5b8da1bb7edb83fa6 Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-VolumesSnapshotsTestJSON-2103613737-project Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: b08a3dd720cf45ffaca3a013dff8db4f Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2103613737-project Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'bad13a14-f6da-4368-bbfb-34e9eff4f57a'} Jun 21 08:22:18.983143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. (HTTP 404) (Request-ID: req-ef4b5024-fd7f-4d3a-81c4-3dc208b52cb8) Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:18.983986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 08:22:18.985578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 08:22:18.987407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7c734071-14dc-4fb1-b254-3547b8961178 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Returning 404 to user: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7c734071-14dc-4fb1-b254-3547b8961178 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a" status: 404 len: 109 microversion: 2.1 time: 0.037347 Jun 21 08:22:18.989019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 401/865] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 08:22:18 2022] DELETE /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:22:18.996740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3bc73a01-2c76-409f-8a69-8a3ea8061cf0 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Calling method '.version_select at 0x7fded2d9c3a0>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:19.031887 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-3bc73a01-2c76-409f-8a69-8a3ea8061cf0 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] HTTP exception thrown: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3bc73a01-2c76-409f-8a69-8a3ea8061cf0 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Request method failure captured: Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a HTTP/1.1 Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX-zC8xQ0AKpiQc4f0wJPd_B1LssWkfT1bSDYBxujrQ4UcsjGft94EsliRtXOlCT0H6-fthZEN83rZb5yBK5ilEZ8iQgKZ0vT2DbvOFv9Er4Rt09_IJ4xkBcxDIAjhhFGVvawxb6p6Kv0BSa79bJGyaTF4NY88ybj4_SPvrIynwqeZE Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: 1b8d0602a7cb4af5b8da1bb7edb83fa6 Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:22:19.033904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1b8d0602a7cb4af5b8da1bb7edb83fa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1b8d0602a7cb4af5b8da1bb7edb83fa6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: 1b8d0602a7cb4af5b8da1bb7edb83fa6 Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2103613737 Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-VolumesSnapshotsTestJSON-2103613737-project Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: b08a3dd720cf45ffaca3a013dff8db4f Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2103613737-project Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'bad13a14-f6da-4368-bbfb-34e9eff4f57a'} Jun 21 08:22:19.035260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. (HTTP 404) (Request-ID: req-dcf02486-4d72-452f-9716-c4c8b2bd5efa) Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:19.036094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 08:22:19.037291 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 08:22:19.038543 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3bc73a01-2c76-409f-8a69-8a3ea8061cf0 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] Returning 404 to user: Volume bad13a14-f6da-4368-bbfb-34e9eff4f57a could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3bc73a01-2c76-409f-8a69-8a3ea8061cf0 tempest-VolumesSnapshotsTestJSON-2103613737 tempest-VolumesSnapshotsTestJSON-2103613737-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a" status: 404 len: 109 microversion: 2.1 time: 0.046740 Jun 21 08:22:19.040236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 465/866] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 08:22:18 2022] GET /compute/v2.1/os-volumes/bad13a14-f6da-4368-bbfb-34e9eff4f57a => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 08:22:19.661229 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d1c4d436-5502-4727-9967-07fcf6ff8f25 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:19.664910 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d1c4d436-5502-4727-9967-07fcf6ff8f25 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:19.686001 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1c4d436-5502-4727-9967-07fcf6ff8f25 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:19.688274 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1c4d436-5502-4727-9967-07fcf6ff8f25 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:19.692018 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1c4d436-5502-4727-9967-07fcf6ff8f25 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:19.693992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1c4d436-5502-4727-9967-07fcf6ff8f25 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:19.994327 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d1c4d436-5502-4727-9967-07fcf6ff8f25 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:20.006148 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d1c4d436-5502-4727-9967-07fcf6ff8f25 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:20.009635 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d1c4d436-5502-4727-9967-07fcf6ff8f25 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:20.010279 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d1c4d436-5502-4727-9967-07fcf6ff8f25 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1740 microversion: 2.20 time: 0.355809 Jun 21 08:22:20.022173 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 402/867] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:19 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:21.030787 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-02bdd47c-7301-4e0f-a814-e145e07d2e0a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:21.032463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-02bdd47c-7301-4e0f-a814-e145e07d2e0a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:21.039288 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-02bdd47c-7301-4e0f-a814-e145e07d2e0a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:21.039848 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-02bdd47c-7301-4e0f-a814-e145e07d2e0a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:21.040954 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-02bdd47c-7301-4e0f-a814-e145e07d2e0a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:21.041637 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-02bdd47c-7301-4e0f-a814-e145e07d2e0a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:21.225676 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-02bdd47c-7301-4e0f-a814-e145e07d2e0a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:21.235947 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-02bdd47c-7301-4e0f-a814-e145e07d2e0a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:21.237821 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-02bdd47c-7301-4e0f-a814-e145e07d2e0a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:21.239214 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-02bdd47c-7301-4e0f-a814-e145e07d2e0a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1740 microversion: 2.20 time: 0.213740 Jun 21 08:22:21.239952 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 466/868] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:21 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:21.396510 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-2e0a9449-49db-43c4-9dc1-c54a23d5e996 req-2ebe01d1-70e6-4056-a504-302776d0dceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c679db4c-d2f2-4b89-8027-39078f9bf5aa", "name": "network-vif-plugged", "status": "completed", "tag": "cf45f811-be66-426a-b1e5-e7bddc45e9f0"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:22:21.408263 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-2e0a9449-49db-43c4-9dc1-c54a23d5e996 req-2ebe01d1-70e6-4056-a504-302776d0dceb service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:21.408899 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-2e0a9449-49db-43c4-9dc1-c54a23d5e996 req-2ebe01d1-70e6-4056-a504-302776d0dceb service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:21.426547 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-2e0a9449-49db-43c4-9dc1-c54a23d5e996 req-2ebe01d1-70e6-4056-a504-302776d0dceb service nova] Creating event network-vif-plugged:cf45f811-be66-426a-b1e5-e7bddc45e9f0 for instance c679db4c-d2f2-4b89-8027-39078f9bf5aa on hv-cinder-83697 Jun 21 08:22:21.432163 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-2e0a9449-49db-43c4-9dc1-c54a23d5e996 req-2ebe01d1-70e6-4056-a504-302776d0dceb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039258 Jun 21 08:22:21.433263 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 403/869] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:22.258890 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-71d008ab-187b-422b-af9b-1b3f4101714c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:22.260525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-71d008ab-187b-422b-af9b-1b3f4101714c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:22.273398 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-71d008ab-187b-422b-af9b-1b3f4101714c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:22.274172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-71d008ab-187b-422b-af9b-1b3f4101714c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:22.275460 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-71d008ab-187b-422b-af9b-1b3f4101714c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:22.276127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-71d008ab-187b-422b-af9b-1b3f4101714c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:22.428186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-71d008ab-187b-422b-af9b-1b3f4101714c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:22.437399 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-71d008ab-187b-422b-af9b-1b3f4101714c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:22.438996 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-71d008ab-187b-422b-af9b-1b3f4101714c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:22.440164 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-71d008ab-187b-422b-af9b-1b3f4101714c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1740 microversion: 2.20 time: 0.185435 Jun 21 08:22:22.441018 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 467/870] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:22 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:23.459238 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-5d11333b-2e52-4d83-87ad-af385accc94e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:23.459933 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-5d11333b-2e52-4d83-87ad-af385accc94e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:23.462903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=45 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:23.467568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5d11333b-2e52-4d83-87ad-af385accc94e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:23.468026 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5d11333b-2e52-4d83-87ad-af385accc94e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:23.469036 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5d11333b-2e52-4d83-87ad-af385accc94e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:23.469623 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-5d11333b-2e52-4d83-87ad-af385accc94e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:23.667643 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5d11333b-2e52-4d83-87ad-af385accc94e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:23.683374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5d11333b-2e52-4d83-87ad-af385accc94e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:23.687754 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-5d11333b-2e52-4d83-87ad-af385accc94e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:23.689174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-5d11333b-2e52-4d83-87ad-af385accc94e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1740 microversion: 2.20 time: 0.234622 Jun 21 08:22:23.690766 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 404/871] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:23 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:24.708878 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c69098d5-9b92-4e1d-ac14-42cec2d0b331 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:24.710113 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c69098d5-9b92-4e1d-ac14-42cec2d0b331 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:24.717327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c69098d5-9b92-4e1d-ac14-42cec2d0b331 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:24.717986 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c69098d5-9b92-4e1d-ac14-42cec2d0b331 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:24.718976 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c69098d5-9b92-4e1d-ac14-42cec2d0b331 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:24.719564 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c69098d5-9b92-4e1d-ac14-42cec2d0b331 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:24.899153 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c69098d5-9b92-4e1d-ac14-42cec2d0b331 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:24.910349 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c69098d5-9b92-4e1d-ac14-42cec2d0b331 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:24.912197 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c69098d5-9b92-4e1d-ac14-42cec2d0b331 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:24.914106 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c69098d5-9b92-4e1d-ac14-42cec2d0b331 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1740 microversion: 2.20 time: 0.209053 Jun 21 08:22:24.916496 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 468/872] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:24 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:25.935918 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-381cce8d-3e2f-44fc-8c01-427e42106dd5 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:25.937371 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-381cce8d-3e2f-44fc-8c01-427e42106dd5 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:25.944210 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-381cce8d-3e2f-44fc-8c01-427e42106dd5 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:25.944661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-381cce8d-3e2f-44fc-8c01-427e42106dd5 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:25.945428 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-381cce8d-3e2f-44fc-8c01-427e42106dd5 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:25.945859 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-381cce8d-3e2f-44fc-8c01-427e42106dd5 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:26.115260 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-381cce8d-3e2f-44fc-8c01-427e42106dd5 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:26.133012 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-381cce8d-3e2f-44fc-8c01-427e42106dd5 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:26.135516 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-381cce8d-3e2f-44fc-8c01-427e42106dd5 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:26.138043 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-381cce8d-3e2f-44fc-8c01-427e42106dd5 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1740 microversion: 2.20 time: 0.206839 Jun 21 08:22:26.139770 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 405/873] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:25 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:27.159460 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d195384d-4f04-44d2-9ac8-c4cb23d9444e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:27.160833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d195384d-4f04-44d2-9ac8-c4cb23d9444e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:27.167830 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d195384d-4f04-44d2-9ac8-c4cb23d9444e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:27.168404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d195384d-4f04-44d2-9ac8-c4cb23d9444e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:27.169403 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d195384d-4f04-44d2-9ac8-c4cb23d9444e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:27.171139 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d195384d-4f04-44d2-9ac8-c4cb23d9444e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:27.340849 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d195384d-4f04-44d2-9ac8-c4cb23d9444e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:27.349918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d195384d-4f04-44d2-9ac8-c4cb23d9444e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:27.351870 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d195384d-4f04-44d2-9ac8-c4cb23d9444e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:27.353213 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d195384d-4f04-44d2-9ac8-c4cb23d9444e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1740 microversion: 2.20 time: 0.199162 Jun 21 08:22:27.353995 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 469/874] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:27 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:22:28.380856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b7d03124-2873-43a4-955b-e85d93e1294c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:28.381983 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b7d03124-2873-43a4-955b-e85d93e1294c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:28.393320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b7d03124-2873-43a4-955b-e85d93e1294c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:28.394108 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b7d03124-2873-43a4-955b-e85d93e1294c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:28.395530 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b7d03124-2873-43a4-955b-e85d93e1294c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:28.396323 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b7d03124-2873-43a4-955b-e85d93e1294c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:28.637054 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b7d03124-2873-43a4-955b-e85d93e1294c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:28.647645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b7d03124-2873-43a4-955b-e85d93e1294c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:28.649246 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b7d03124-2873-43a4-955b-e85d93e1294c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:28.650436 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b7d03124-2873-43a4-955b-e85d93e1294c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1740 microversion: 2.20 time: 0.280221 Jun 21 08:22:28.651035 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 406/875] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:28 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:29.678025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1fc9c625-e82f-4f72-9561-37629300e606 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:29.678771 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1fc9c625-e82f-4f72-9561-37629300e606 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:29.681200 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:29.687708 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1fc9c625-e82f-4f72-9561-37629300e606 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:29.688185 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1fc9c625-e82f-4f72-9561-37629300e606 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:29.688960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1fc9c625-e82f-4f72-9561-37629300e606 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:29.689417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1fc9c625-e82f-4f72-9561-37629300e606 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:29.837884 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1fc9c625-e82f-4f72-9561-37629300e606 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:29.847788 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1fc9c625-e82f-4f72-9561-37629300e606 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:29.849360 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1fc9c625-e82f-4f72-9561-37629300e606 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:29.850678 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1fc9c625-e82f-4f72-9561-37629300e606 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1740 microversion: 2.20 time: 0.176389 Jun 21 08:22:29.851313 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 470/876] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:29 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:22:30.870194 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-12169766-d59c-47ab-b52e-542d750741a0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:30.870831 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-12169766-d59c-47ab-b52e-542d750741a0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:30.877699 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12169766-d59c-47ab-b52e-542d750741a0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:30.878398 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12169766-d59c-47ab-b52e-542d750741a0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:30.879198 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12169766-d59c-47ab-b52e-542d750741a0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:30.879667 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12169766-d59c-47ab-b52e-542d750741a0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:31.013107 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-12169766-d59c-47ab-b52e-542d750741a0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:31.021261 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-12169766-d59c-47ab-b52e-542d750741a0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:31.022715 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-12169766-d59c-47ab-b52e-542d750741a0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:31.023887 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-12169766-d59c-47ab-b52e-542d750741a0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1722 microversion: 2.20 time: 0.158084 Jun 21 08:22:31.036601 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 407/877] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:30 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:32.044240 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4fc1aaf6-4c6b-4187-8fa2-1a5013f88776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:32.045394 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4fc1aaf6-4c6b-4187-8fa2-1a5013f88776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:32.051661 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4fc1aaf6-4c6b-4187-8fa2-1a5013f88776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:32.052113 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4fc1aaf6-4c6b-4187-8fa2-1a5013f88776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:32.052874 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4fc1aaf6-4c6b-4187-8fa2-1a5013f88776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:32.053307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4fc1aaf6-4c6b-4187-8fa2-1a5013f88776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:32.057205 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:32.185488 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4fc1aaf6-4c6b-4187-8fa2-1a5013f88776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:32.193579 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4fc1aaf6-4c6b-4187-8fa2-1a5013f88776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:32.195100 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4fc1aaf6-4c6b-4187-8fa2-1a5013f88776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:32.196247 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4fc1aaf6-4c6b-4187-8fa2-1a5013f88776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1722 microversion: 2.20 time: 0.155922 Jun 21 08:22:32.196800 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 471/878] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:32 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:33.215041 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4a23a1e1-f600-4348-be29-38b92833c07f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:33.215768 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4a23a1e1-f600-4348-be29-38b92833c07f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:33.223719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4a23a1e1-f600-4348-be29-38b92833c07f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:33.224165 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4a23a1e1-f600-4348-be29-38b92833c07f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:33.225143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4a23a1e1-f600-4348-be29-38b92833c07f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:33.225633 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4a23a1e1-f600-4348-be29-38b92833c07f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:33.322081 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-6c53c941-4d8d-4ff3-873f-5ee8cdeb9164 req-cbe47e28-c45c-4e14-81e2-ed2d84b7a65e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c679db4c-d2f2-4b89-8027-39078f9bf5aa", "name": "network-vif-unplugged", "status": "completed", "tag": "cf45f811-be66-426a-b1e5-e7bddc45e9f0"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:22:33.335110 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-6c53c941-4d8d-4ff3-873f-5ee8cdeb9164 req-cbe47e28-c45c-4e14-81e2-ed2d84b7a65e service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:33.335796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-6c53c941-4d8d-4ff3-873f-5ee8cdeb9164 req-cbe47e28-c45c-4e14-81e2-ed2d84b7a65e service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:33.350901 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-6c53c941-4d8d-4ff3-873f-5ee8cdeb9164 req-cbe47e28-c45c-4e14-81e2-ed2d84b7a65e service nova] Creating event network-vif-unplugged:cf45f811-be66-426a-b1e5-e7bddc45e9f0 for instance c679db4c-d2f2-4b89-8027-39078f9bf5aa on hv-cinder-83697 Jun 21 08:22:33.356301 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-6c53c941-4d8d-4ff3-873f-5ee8cdeb9164 req-cbe47e28-c45c-4e14-81e2-ed2d84b7a65e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039899 Jun 21 08:22:33.357164 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 472/879] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:33.372037 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4a23a1e1-f600-4348-be29-38b92833c07f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:33.380800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4a23a1e1-f600-4348-be29-38b92833c07f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:33.382294 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4a23a1e1-f600-4348-be29-38b92833c07f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:33.383517 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4a23a1e1-f600-4348-be29-38b92833c07f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1722 microversion: 2.20 time: 0.172938 Jun 21 08:22:33.384071 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 408/880] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:33 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:34.402572 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-73c233cf-c546-41ed-b370-ea8690cbc6f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:34.403359 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-73c233cf-c546-41ed-b370-ea8690cbc6f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:34.413671 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-73c233cf-c546-41ed-b370-ea8690cbc6f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:34.414272 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-73c233cf-c546-41ed-b370-ea8690cbc6f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:34.415136 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-73c233cf-c546-41ed-b370-ea8690cbc6f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:34.415638 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-73c233cf-c546-41ed-b370-ea8690cbc6f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:34.548338 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-73c233cf-c546-41ed-b370-ea8690cbc6f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:34.556143 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-73c233cf-c546-41ed-b370-ea8690cbc6f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:34.557681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-73c233cf-c546-41ed-b370-ea8690cbc6f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:34.558801 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-73c233cf-c546-41ed-b370-ea8690cbc6f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1725 microversion: 2.20 time: 0.160504 Jun 21 08:22:34.559369 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 473/881] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:34 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:34.577548 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0a4c38b4-5cea-444d-af7a-985a36dad35b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "957e3e2d-4d4d-42db-a7d1-463624031058"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:22:34.578604 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0a4c38b4-5cea-444d-af7a-985a36dad35b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:34.585178 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0a4c38b4-5cea-444d-af7a-985a36dad35b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:34.585620 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0a4c38b4-5cea-444d-af7a-985a36dad35b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:34.586377 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0a4c38b4-5cea-444d-af7a-985a36dad35b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:34.586836 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0a4c38b4-5cea-444d-af7a-985a36dad35b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:35.033491 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0a4c38b4-5cea-444d-af7a-985a36dad35b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "POST /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.460383 Jun 21 08:22:35.034130 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 409/882] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Jun 21 08:22:34 2022] POST /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-volume_attachments => generated 188 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:22:35.146935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-eb043234-7cf0-45cd-9cb0-0f27f24d5d6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:22:35.147503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-eb043234-7cf0-45cd-9cb0-0f27f24d5d6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:35.153583 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eb043234-7cf0-45cd-9cb0-0f27f24d5d6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:35.154589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eb043234-7cf0-45cd-9cb0-0f27f24d5d6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:35.155393 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eb043234-7cf0-45cd-9cb0-0f27f24d5d6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:35.155827 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eb043234-7cf0-45cd-9cb0-0f27f24d5d6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:35.231136 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-eb043234-7cf0-45cd-9cb0-0f27f24d5d6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "POST /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/action" status: 202 len: 0 microversion: 2.20 time: 0.088062 Jun 21 08:22:35.231875 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 474/883] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 21 08:22:35 2022] POST /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:22:35.242204 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-12324a94-ac0e-48ea-9245-64809b188037 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:35.242204 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-12324a94-ac0e-48ea-9245-64809b188037 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:35.246907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12324a94-ac0e-48ea-9245-64809b188037 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:35.247365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12324a94-ac0e-48ea-9245-64809b188037 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:35.248113 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12324a94-ac0e-48ea-9245-64809b188037 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:35.248645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-12324a94-ac0e-48ea-9245-64809b188037 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:35.381032 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-12324a94-ac0e-48ea-9245-64809b188037 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:35.390185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-12324a94-ac0e-48ea-9245-64809b188037 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:35.391701 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-12324a94-ac0e-48ea-9245-64809b188037 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:35.392864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-12324a94-ac0e-48ea-9245-64809b188037 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1751 microversion: 2.20 time: 0.156748 Jun 21 08:22:35.393432 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 410/884] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:35 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:36.413365 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d69914aa-e0e1-470e-95a4-823776dbe62b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:36.414016 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d69914aa-e0e1-470e-95a4-823776dbe62b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:36.421007 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d69914aa-e0e1-470e-95a4-823776dbe62b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:36.421458 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d69914aa-e0e1-470e-95a4-823776dbe62b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:36.422228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d69914aa-e0e1-470e-95a4-823776dbe62b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:36.422681 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d69914aa-e0e1-470e-95a4-823776dbe62b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:36.557807 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d69914aa-e0e1-470e-95a4-823776dbe62b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:36.567148 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d69914aa-e0e1-470e-95a4-823776dbe62b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:36.568729 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d69914aa-e0e1-470e-95a4-823776dbe62b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:36.569913 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d69914aa-e0e1-470e-95a4-823776dbe62b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1751 microversion: 2.20 time: 0.160929 Jun 21 08:22:36.570814 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 475/885] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:36 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:37.588491 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d1b7e6d1-e38c-4419-a412-b0bfd429d4e3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:37.589109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d1b7e6d1-e38c-4419-a412-b0bfd429d4e3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:37.596410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1b7e6d1-e38c-4419-a412-b0bfd429d4e3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:37.596863 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1b7e6d1-e38c-4419-a412-b0bfd429d4e3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:37.597626 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1b7e6d1-e38c-4419-a412-b0bfd429d4e3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:37.598059 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d1b7e6d1-e38c-4419-a412-b0bfd429d4e3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:37.727560 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d1b7e6d1-e38c-4419-a412-b0bfd429d4e3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:37.736479 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d1b7e6d1-e38c-4419-a412-b0bfd429d4e3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:37.737976 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d1b7e6d1-e38c-4419-a412-b0bfd429d4e3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:37.739197 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d1b7e6d1-e38c-4419-a412-b0bfd429d4e3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1753 microversion: 2.20 time: 0.154678 Jun 21 08:22:37.739751 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 411/886] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:37 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:38.759393 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-2f4e4b4c-ddb2-4a16-93aa-e2d99fe63808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:38.767888 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-2f4e4b4c-ddb2-4a16-93aa-e2d99fe63808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:38.774411 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2f4e4b4c-ddb2-4a16-93aa-e2d99fe63808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:38.774880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2f4e4b4c-ddb2-4a16-93aa-e2d99fe63808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:38.775833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2f4e4b4c-ddb2-4a16-93aa-e2d99fe63808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:38.776266 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2f4e4b4c-ddb2-4a16-93aa-e2d99fe63808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:38.922152 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2f4e4b4c-ddb2-4a16-93aa-e2d99fe63808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:38.931205 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2f4e4b4c-ddb2-4a16-93aa-e2d99fe63808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:38.932777 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2f4e4b4c-ddb2-4a16-93aa-e2d99fe63808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:38.933932 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-2f4e4b4c-ddb2-4a16-93aa-e2d99fe63808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1753 microversion: 2.20 time: 0.178457 Jun 21 08:22:38.934492 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 476/887] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:38 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:39.953933 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-601b0a86-21a5-406d-ac5f-d2ea4016689a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:39.954694 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-601b0a86-21a5-406d-ac5f-d2ea4016689a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:39.961791 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-601b0a86-21a5-406d-ac5f-d2ea4016689a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:39.962233 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-601b0a86-21a5-406d-ac5f-d2ea4016689a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:39.963032 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-601b0a86-21a5-406d-ac5f-d2ea4016689a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:39.963463 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-601b0a86-21a5-406d-ac5f-d2ea4016689a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:40.104194 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-601b0a86-21a5-406d-ac5f-d2ea4016689a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:40.113408 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-601b0a86-21a5-406d-ac5f-d2ea4016689a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:40.114953 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-601b0a86-21a5-406d-ac5f-d2ea4016689a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:40.116149 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-601b0a86-21a5-406d-ac5f-d2ea4016689a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.166708 Jun 21 08:22:40.116706 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 412/888] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:39 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:41.135306 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-07dfeabd-df79-46f0-acc2-bf0b17be32f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:41.136620 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-07dfeabd-df79-46f0-acc2-bf0b17be32f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:41.144098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-07dfeabd-df79-46f0-acc2-bf0b17be32f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:41.144540 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-07dfeabd-df79-46f0-acc2-bf0b17be32f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:41.145510 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-07dfeabd-df79-46f0-acc2-bf0b17be32f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:41.146129 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-07dfeabd-df79-46f0-acc2-bf0b17be32f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:41.291330 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-07dfeabd-df79-46f0-acc2-bf0b17be32f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:41.318933 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-07dfeabd-df79-46f0-acc2-bf0b17be32f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:41.320735 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-07dfeabd-df79-46f0-acc2-bf0b17be32f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:41.322307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-07dfeabd-df79-46f0-acc2-bf0b17be32f7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.190952 Jun 21 08:22:41.334267 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 477/889] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:41 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:42.343723 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-411e71e6-e42e-45c7-8254-b1d22d4cd6c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:42.344982 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-411e71e6-e42e-45c7-8254-b1d22d4cd6c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:42.351713 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-411e71e6-e42e-45c7-8254-b1d22d4cd6c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:42.352335 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-411e71e6-e42e-45c7-8254-b1d22d4cd6c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:42.353150 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-411e71e6-e42e-45c7-8254-b1d22d4cd6c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:42.353617 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-411e71e6-e42e-45c7-8254-b1d22d4cd6c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:42.500622 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-411e71e6-e42e-45c7-8254-b1d22d4cd6c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:42.512046 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-411e71e6-e42e-45c7-8254-b1d22d4cd6c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:42.514795 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-411e71e6-e42e-45c7-8254-b1d22d4cd6c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:42.516631 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-411e71e6-e42e-45c7-8254-b1d22d4cd6c8 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.178836 Jun 21 08:22:42.517357 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 413/890] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:42 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:43.537300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a0219b77-eb7d-4c4e-b9a6-00556708d0eb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:43.538610 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a0219b77-eb7d-4c4e-b9a6-00556708d0eb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:43.547137 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0219b77-eb7d-4c4e-b9a6-00556708d0eb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:43.547882 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0219b77-eb7d-4c4e-b9a6-00556708d0eb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:43.548839 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0219b77-eb7d-4c4e-b9a6-00556708d0eb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:43.549623 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0219b77-eb7d-4c4e-b9a6-00556708d0eb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:43.948415 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a0219b77-eb7d-4c4e-b9a6-00556708d0eb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:43.963906 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a0219b77-eb7d-4c4e-b9a6-00556708d0eb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:43.965894 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a0219b77-eb7d-4c4e-b9a6-00556708d0eb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:43.968631 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a0219b77-eb7d-4c4e-b9a6-00556708d0eb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.436133 Jun 21 08:22:43.969926 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 478/891] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:43 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:44.988190 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c426f808-d79f-44a3-ad86-df594784c517 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:44.988808 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c426f808-d79f-44a3-ad86-df594784c517 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:44.996416 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c426f808-d79f-44a3-ad86-df594784c517 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:44.996879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c426f808-d79f-44a3-ad86-df594784c517 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:44.998448 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c426f808-d79f-44a3-ad86-df594784c517 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:44.999237 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c426f808-d79f-44a3-ad86-df594784c517 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:45.005193 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:45.172556 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c426f808-d79f-44a3-ad86-df594784c517 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:45.182954 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c426f808-d79f-44a3-ad86-df594784c517 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:45.184480 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c426f808-d79f-44a3-ad86-df594784c517 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:45.186594 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c426f808-d79f-44a3-ad86-df594784c517 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.202285 Jun 21 08:22:45.187380 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 414/892] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:44 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:46.206603 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fe8dc8f5-bc27-4511-829b-8600bc45cdda tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:46.208132 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fe8dc8f5-bc27-4511-829b-8600bc45cdda tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:46.215558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fe8dc8f5-bc27-4511-829b-8600bc45cdda tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:46.217007 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fe8dc8f5-bc27-4511-829b-8600bc45cdda tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:46.218019 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fe8dc8f5-bc27-4511-829b-8600bc45cdda tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:46.218502 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fe8dc8f5-bc27-4511-829b-8600bc45cdda tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:46.379295 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fe8dc8f5-bc27-4511-829b-8600bc45cdda tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:46.391988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fe8dc8f5-bc27-4511-829b-8600bc45cdda tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:46.394059 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fe8dc8f5-bc27-4511-829b-8600bc45cdda tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:46.400464 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fe8dc8f5-bc27-4511-829b-8600bc45cdda tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.197556 Jun 21 08:22:46.415182 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 479/893] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:46 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:47.426428 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bd927988-190e-498e-b80e-bcd8389f45e6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:47.427931 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bd927988-190e-498e-b80e-bcd8389f45e6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:47.446307 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd927988-190e-498e-b80e-bcd8389f45e6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:47.448494 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd927988-190e-498e-b80e-bcd8389f45e6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:47.476380 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd927988-190e-498e-b80e-bcd8389f45e6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:47.476923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd927988-190e-498e-b80e-bcd8389f45e6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:47.666452 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bd927988-190e-498e-b80e-bcd8389f45e6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:47.684585 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bd927988-190e-498e-b80e-bcd8389f45e6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:47.687498 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bd927988-190e-498e-b80e-bcd8389f45e6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:47.689753 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bd927988-190e-498e-b80e-bcd8389f45e6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.266965 Jun 21 08:22:47.690719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 415/894] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:47 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:48.717908 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ea1a046a-817b-4667-91c8-d672df7dc957 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:48.718515 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ea1a046a-817b-4667-91c8-d672df7dc957 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:48.725001 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ea1a046a-817b-4667-91c8-d672df7dc957 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:48.725447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ea1a046a-817b-4667-91c8-d672df7dc957 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:48.726203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ea1a046a-817b-4667-91c8-d672df7dc957 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:48.726655 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ea1a046a-817b-4667-91c8-d672df7dc957 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:48.861226 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ea1a046a-817b-4667-91c8-d672df7dc957 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:48.869709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ea1a046a-817b-4667-91c8-d672df7dc957 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:48.871225 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ea1a046a-817b-4667-91c8-d672df7dc957 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:48.872864 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ea1a046a-817b-4667-91c8-d672df7dc957 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.159053 Jun 21 08:22:48.873565 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 480/895] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:48 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:49.892777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-792ad523-c50f-436c-a963-87650d34ee7e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:49.893616 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-792ad523-c50f-436c-a963-87650d34ee7e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:49.901165 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-792ad523-c50f-436c-a963-87650d34ee7e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:49.901630 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-792ad523-c50f-436c-a963-87650d34ee7e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:49.902555 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-792ad523-c50f-436c-a963-87650d34ee7e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:49.903204 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-792ad523-c50f-436c-a963-87650d34ee7e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:49.995403 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f87f525c-7ea4-4077-9396-da64d277732b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:49.995896 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f87f525c-7ea4-4077-9396-da64d277732b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:50.011596 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f87f525c-7ea4-4077-9396-da64d277732b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:50.012116 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f87f525c-7ea4-4077-9396-da64d277732b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:50.013255 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f87f525c-7ea4-4077-9396-da64d277732b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:50.013820 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f87f525c-7ea4-4077-9396-da64d277732b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:50.041767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f87f525c-7ea4-4077-9396-da64d277732b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Going to try to terminate instance {{(pid=117547) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:22:50.056181 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-792ad523-c50f-436c-a963-87650d34ee7e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:50.068003 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-792ad523-c50f-436c-a963-87650d34ee7e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:50.081680 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-792ad523-c50f-436c-a963-87650d34ee7e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:50.083161 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-792ad523-c50f-436c-a963-87650d34ee7e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.195532 Jun 21 08:22:50.084076 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 416/896] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:49 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:50.155756 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f87f525c-7ea4-4077-9396-da64d277732b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 204 len: 0 microversion: 2.1 time: 0.163988 Jun 21 08:22:50.159460 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 481/897] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:22:49 2022] DELETE /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:22:50.165125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-68ca04be-2a3c-4908-86ef-5c6d37b5c70a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:50.166139 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-68ca04be-2a3c-4908-86ef-5c6d37b5c70a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:50.174672 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-68ca04be-2a3c-4908-86ef-5c6d37b5c70a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:50.175163 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-68ca04be-2a3c-4908-86ef-5c6d37b5c70a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:50.175983 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-68ca04be-2a3c-4908-86ef-5c6d37b5c70a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:50.176447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-68ca04be-2a3c-4908-86ef-5c6d37b5c70a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:50.253948 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-efcfcbf4-99d2-4354-b6e8-638ad7feefaf req-df71c528-b59a-4899-b819-c308221c8671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d983b34e-0d69-4afd-9bb6-f13213be6bb1", "tag": "db75733d-f744-4c74-924b-254ed8090967"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:22:50.260994 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-efcfcbf4-99d2-4354-b6e8-638ad7feefaf req-df71c528-b59a-4899-b819-c308221c8671 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:50.261444 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-efcfcbf4-99d2-4354-b6e8-638ad7feefaf req-df71c528-b59a-4899-b819-c308221c8671 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:50.272803 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-efcfcbf4-99d2-4354-b6e8-638ad7feefaf req-df71c528-b59a-4899-b819-c308221c8671 service nova] Creating event network-changed:db75733d-f744-4c74-924b-254ed8090967 for instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 on hv-cinder-83697 Jun 21 08:22:50.277907 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-efcfcbf4-99d2-4354-b6e8-638ad7feefaf req-df71c528-b59a-4899-b819-c308221c8671 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192451 Jun 21 08:22:50.279090 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 417/898] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:50.330941 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-68ca04be-2a3c-4908-86ef-5c6d37b5c70a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:50.338635 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-68ca04be-2a3c-4908-86ef-5c6d37b5c70a tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.177956 Jun 21 08:22:50.339337 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 482/899] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:22:50 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:22:51.108918 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0af9b9ad-cfb1-4e82-a61f-6d2b33aad071 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:51.109642 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-0af9b9ad-cfb1-4e82-a61f-6d2b33aad071 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:51.116886 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0af9b9ad-cfb1-4e82-a61f-6d2b33aad071 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:51.117330 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0af9b9ad-cfb1-4e82-a61f-6d2b33aad071 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:51.118099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0af9b9ad-cfb1-4e82-a61f-6d2b33aad071 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:51.118526 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-0af9b9ad-cfb1-4e82-a61f-6d2b33aad071 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:51.293788 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0af9b9ad-cfb1-4e82-a61f-6d2b33aad071 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:51.303436 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0af9b9ad-cfb1-4e82-a61f-6d2b33aad071 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:51.304933 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-0af9b9ad-cfb1-4e82-a61f-6d2b33aad071 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:51.306125 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0af9b9ad-cfb1-4e82-a61f-6d2b33aad071 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.207708 Jun 21 08:22:51.306713 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 418/900] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:51 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:51.356697 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d811d6d8-08d9-4811-9f0b-826628ab60fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:51.357233 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d811d6d8-08d9-4811-9f0b-826628ab60fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:51.365240 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d811d6d8-08d9-4811-9f0b-826628ab60fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:51.365240 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d811d6d8-08d9-4811-9f0b-826628ab60fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:51.365240 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d811d6d8-08d9-4811-9f0b-826628ab60fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:51.365687 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d811d6d8-08d9-4811-9f0b-826628ab60fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:51.538259 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d811d6d8-08d9-4811-9f0b-826628ab60fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:51.546963 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d811d6d8-08d9-4811-9f0b-826628ab60fb tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1571 microversion: 2.1 time: 0.194391 Jun 21 08:22:51.547555 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 483/901] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:22:51 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1571 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:22:52.324902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b1da6aa3-1929-4f06-83ca-118ecd0e0541 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:52.327147 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b1da6aa3-1929-4f06-83ca-118ecd0e0541 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:52.334258 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b1da6aa3-1929-4f06-83ca-118ecd0e0541 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:52.335215 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b1da6aa3-1929-4f06-83ca-118ecd0e0541 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:52.335730 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b1da6aa3-1929-4f06-83ca-118ecd0e0541 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:52.336357 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b1da6aa3-1929-4f06-83ca-118ecd0e0541 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:52.406201 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-a21a64df-b819-48f5-93f8-9b35b94979c0 req-c0731862-6852-4d51-8fba-17544ed2a84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d983b34e-0d69-4afd-9bb6-f13213be6bb1", "name": "network-vif-deleted", "tag": "db75733d-f744-4c74-924b-254ed8090967"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:22:52.420954 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-a21a64df-b819-48f5-93f8-9b35b94979c0 req-c0731862-6852-4d51-8fba-17544ed2a84d service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:52.421399 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-a21a64df-b819-48f5-93f8-9b35b94979c0 req-c0731862-6852-4d51-8fba-17544ed2a84d service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:52.436557 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-a21a64df-b819-48f5-93f8-9b35b94979c0 req-c0731862-6852-4d51-8fba-17544ed2a84d service nova] Creating event network-vif-deleted:db75733d-f744-4c74-924b-254ed8090967 for instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 on hv-cinder-83697 Jun 21 08:22:52.441669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-a21a64df-b819-48f5-93f8-9b35b94979c0 req-c0731862-6852-4d51-8fba-17544ed2a84d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040577 Jun 21 08:22:52.442419 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 484/902] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:52.496718 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b1da6aa3-1929-4f06-83ca-118ecd0e0541 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:52.505965 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b1da6aa3-1929-4f06-83ca-118ecd0e0541 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:52.507586 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b1da6aa3-1929-4f06-83ca-118ecd0e0541 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:52.510453 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b1da6aa3-1929-4f06-83ca-118ecd0e0541 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.189848 Jun 21 08:22:52.511078 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 419/903] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:52 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:52.565021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a0bb5d85-c8cf-4cea-9b9f-75b362661c22 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:52.565633 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a0bb5d85-c8cf-4cea-9b9f-75b362661c22 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:52.572251 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0bb5d85-c8cf-4cea-9b9f-75b362661c22 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:52.572616 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0bb5d85-c8cf-4cea-9b9f-75b362661c22 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:52.573378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0bb5d85-c8cf-4cea-9b9f-75b362661c22 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:52.573808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a0bb5d85-c8cf-4cea-9b9f-75b362661c22 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:52.639694 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a0bb5d85-c8cf-4cea-9b9f-75b362661c22 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b54a55cff584d948b96c1c439e57eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad2999c58284b92b7166848a3e1f261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:52.647470 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a0bb5d85-c8cf-4cea-9b9f-75b362661c22 tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 200 len: 1220 microversion: 2.1 time: 0.086845 Jun 21 08:22:52.648030 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 485/904] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:22:52 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:22:53.529490 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-64303fab-79d3-4a66-99cd-e880625d3c6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:53.530120 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-64303fab-79d3-4a66-99cd-e880625d3c6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:53.532247 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=32 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:53.537476 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-64303fab-79d3-4a66-99cd-e880625d3c6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:53.537925 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-64303fab-79d3-4a66-99cd-e880625d3c6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:53.538716 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-64303fab-79d3-4a66-99cd-e880625d3c6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:53.539156 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-64303fab-79d3-4a66-99cd-e880625d3c6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:53.673131 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1e669adb-bd48-41aa-9dd9-0701cd224e8e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:53.674221 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1e669adb-bd48-41aa-9dd9-0701cd224e8e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] [instance: d983b34e-0d69-4afd-9bb6-f13213be6bb1] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:53.685176 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1e669adb-bd48-41aa-9dd9-0701cd224e8e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:53.685961 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1e669adb-bd48-41aa-9dd9-0701cd224e8e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:53.686872 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-64303fab-79d3-4a66-99cd-e880625d3c6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:53.687683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1e669adb-bd48-41aa-9dd9-0701cd224e8e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:53.688724 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1e669adb-bd48-41aa-9dd9-0701cd224e8e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:53.699280 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-64303fab-79d3-4a66-99cd-e880625d3c6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:53.702177 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-64303fab-79d3-4a66-99cd-e880625d3c6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:53.704013 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-64303fab-79d3-4a66-99cd-e880625d3c6c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.178788 Jun 21 08:22:53.704768 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 420/905] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:53 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:53.708994 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-1e669adb-bd48-41aa-9dd9-0701cd224e8e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] HTTP exception thrown: Instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 could not be found. Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1e669adb-bd48-41aa-9dd9-0701cd224e8e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Request method failure captured: Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 HTTP/1.1 Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX5-wCfBGVNLxsF5y2--bqrCnruwkY8s81_9UdHlxZogBC8l_SEct3GnvATfi4T8vYQhBcR67yWoEbGebTN_A8eBSV7pvg5UYOpWRBzvokr5dFOcAvOR-QvA8nh5_0XCKqnbBCqqFMFZbZ00-YG5K5gzSPjns8Jz1Ub3zqIX87m--vQ Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: cad2999c58284b92b7166848a3e1f261 Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-TestShelveInstance-894213931 Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:22:53.711063 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cad2999c58284b92b7166848a3e1f261"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cad2999c58284b92b7166848a3e1f261"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cad2999c58284b92b7166848a3e1f261"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cad2999c58284b92b7166848a3e1f261", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-TestShelveInstance-894213931 Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: cad2999c58284b92b7166848a3e1f261 Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-TestShelveInstance-894213931 Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-TestShelveInstance-894213931-project Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 8b54a55cff584d948b96c1c439e57eda Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-TestShelveInstance-894213931-project Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 could not be found. Jun 21 08:22:53.713767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'd983b34e-0d69-4afd-9bb6-f13213be6bb1'} Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 could not be found. Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:22:53.716767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 could not be found. Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 could not be found. Jun 21 08:22:53.719021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:22:53.725541 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1e669adb-bd48-41aa-9dd9-0701cd224e8e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Returning 404 to user: Instance d983b34e-0d69-4afd-9bb6-f13213be6bb1 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:22:53.725541 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1e669adb-bd48-41aa-9dd9-0701cd224e8e tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1" status: 404 len: 111 microversion: 2.1 time: 0.050830 Jun 21 08:22:53.725541 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 486/906] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:22:53 2022] GET /compute/v2.1/servers/d983b34e-0d69-4afd-9bb6-f13213be6bb1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 08:22:53.924025 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6ee9e8bc-a3e4-4031-a819-1fb7b9b1430b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] Calling method '.version_select at 0x7fded2eae820>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:53.943494 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6ee9e8bc-a3e4-4031-a819-1fb7b9b1430b tempest-TestShelveInstance-894213931 tempest-TestShelveInstance-894213931-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1346110402" status: 202 len: 0 microversion: 2.1 time: 0.024697 Jun 21 08:22:53.947655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 421/907] 10.222.0.36 () {58 vars in 1253 bytes} [Tue Jun 21 08:22:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1346110402 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:22:54.728029 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-38601a95-35ae-4beb-a1ee-723cf9ad8390 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:54.728667 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-38601a95-35ae-4beb-a1ee-723cf9ad8390 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:54.739027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-38601a95-35ae-4beb-a1ee-723cf9ad8390 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:54.739445 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-38601a95-35ae-4beb-a1ee-723cf9ad8390 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:54.740368 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-38601a95-35ae-4beb-a1ee-723cf9ad8390 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:54.740826 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-38601a95-35ae-4beb-a1ee-723cf9ad8390 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:54.744006 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:54.974463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-38601a95-35ae-4beb-a1ee-723cf9ad8390 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:54.984255 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-38601a95-35ae-4beb-a1ee-723cf9ad8390 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:54.985773 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-38601a95-35ae-4beb-a1ee-723cf9ad8390 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:54.987204 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-38601a95-35ae-4beb-a1ee-723cf9ad8390 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.263348 Jun 21 08:22:54.988095 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 487/908] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:54 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:56.007015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-16d0259a-000d-4982-9013-ba40b9ecee0f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:56.008435 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-16d0259a-000d-4982-9013-ba40b9ecee0f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:56.015609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-16d0259a-000d-4982-9013-ba40b9ecee0f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:56.016185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-16d0259a-000d-4982-9013-ba40b9ecee0f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:56.017054 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-16d0259a-000d-4982-9013-ba40b9ecee0f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:56.017570 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-16d0259a-000d-4982-9013-ba40b9ecee0f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:56.211358 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-16d0259a-000d-4982-9013-ba40b9ecee0f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:56.223628 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-16d0259a-000d-4982-9013-ba40b9ecee0f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:56.225639 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-16d0259a-000d-4982-9013-ba40b9ecee0f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:56.227162 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-16d0259a-000d-4982-9013-ba40b9ecee0f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.225104 Jun 21 08:22:56.227721 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 422/909] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:56 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:57.249431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-08c7aff3-318e-427e-a492-ce839a2e48c0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:57.250107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-08c7aff3-318e-427e-a492-ce839a2e48c0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:57.257513 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-08c7aff3-318e-427e-a492-ce839a2e48c0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:57.258154 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-08c7aff3-318e-427e-a492-ce839a2e48c0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:57.259273 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-08c7aff3-318e-427e-a492-ce839a2e48c0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:57.259860 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-08c7aff3-318e-427e-a492-ce839a2e48c0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:57.414556 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-08c7aff3-318e-427e-a492-ce839a2e48c0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:57.425406 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-08c7aff3-318e-427e-a492-ce839a2e48c0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:57.427096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-08c7aff3-318e-427e-a492-ce839a2e48c0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:57.428452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-08c7aff3-318e-427e-a492-ce839a2e48c0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.183873 Jun 21 08:22:57.429110 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 488/910] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:57 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:58.447170 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fe30b0be-bf04-45ff-adb8-9d52ffbd006a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:58.448314 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-fe30b0be-bf04-45ff-adb8-9d52ffbd006a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:58.456332 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe30b0be-bf04-45ff-adb8-9d52ffbd006a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:58.456787 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe30b0be-bf04-45ff-adb8-9d52ffbd006a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:58.457570 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe30b0be-bf04-45ff-adb8-9d52ffbd006a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:58.458192 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fe30b0be-bf04-45ff-adb8-9d52ffbd006a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:58.625586 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fe30b0be-bf04-45ff-adb8-9d52ffbd006a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:58.637003 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fe30b0be-bf04-45ff-adb8-9d52ffbd006a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:58.640541 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fe30b0be-bf04-45ff-adb8-9d52ffbd006a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:58.641911 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fe30b0be-bf04-45ff-adb8-9d52ffbd006a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.198892 Jun 21 08:22:58.642529 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 423/911] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:58 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:22:59.642270 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-1a5bbfee-4328-44f1-adc4-f4fea5323683 req-46a46d88-d7f2-483a-b5de-1a9f43d2b796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c679db4c-d2f2-4b89-8027-39078f9bf5aa", "name": "network-vif-plugged", "status": "completed", "tag": "cf45f811-be66-426a-b1e5-e7bddc45e9f0"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:22:59.660738 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-1a5bbfee-4328-44f1-adc4-f4fea5323683 req-46a46d88-d7f2-483a-b5de-1a9f43d2b796 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:59.661479 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-1a5bbfee-4328-44f1-adc4-f4fea5323683 req-46a46d88-d7f2-483a-b5de-1a9f43d2b796 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:59.663724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f63305f1-38fb-464c-8eac-9881172ff7cb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:22:59.665206 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f63305f1-38fb-464c-8eac-9881172ff7cb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:22:59.675352 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f63305f1-38fb-464c-8eac-9881172ff7cb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:59.676270 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f63305f1-38fb-464c-8eac-9881172ff7cb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:59.677531 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f63305f1-38fb-464c-8eac-9881172ff7cb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:22:59.678685 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f63305f1-38fb-464c-8eac-9881172ff7cb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:22:59.689389 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-1a5bbfee-4328-44f1-adc4-f4fea5323683 req-46a46d88-d7f2-483a-b5de-1a9f43d2b796 service nova] Creating event network-vif-plugged:cf45f811-be66-426a-b1e5-e7bddc45e9f0 for instance c679db4c-d2f2-4b89-8027-39078f9bf5aa on hv-cinder-83697 Jun 21 08:22:59.700989 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-1a5bbfee-4328-44f1-adc4-f4fea5323683 req-46a46d88-d7f2-483a-b5de-1a9f43d2b796 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061730 Jun 21 08:22:59.702186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 489/912] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:22:59.948058 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f63305f1-38fb-464c-8eac-9881172ff7cb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:59.960318 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f63305f1-38fb-464c-8eac-9881172ff7cb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:59.962302 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f63305f1-38fb-464c-8eac-9881172ff7cb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:22:59.964110 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f63305f1-38fb-464c-8eac-9881172ff7cb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.306419 Jun 21 08:22:59.965187 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 424/913] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:22:59 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:23:00.983915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ef4cce8d-1fb5-4d1a-ad52-47820e9e626f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:00.984701 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ef4cce8d-1fb5-4d1a-ad52-47820e9e626f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:00.995721 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:01.004354 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef4cce8d-1fb5-4d1a-ad52-47820e9e626f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:01.005065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef4cce8d-1fb5-4d1a-ad52-47820e9e626f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:01.006943 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef4cce8d-1fb5-4d1a-ad52-47820e9e626f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:01.007409 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef4cce8d-1fb5-4d1a-ad52-47820e9e626f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:01.251680 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ef4cce8d-1fb5-4d1a-ad52-47820e9e626f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:01.264701 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ef4cce8d-1fb5-4d1a-ad52-47820e9e626f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:01.266238 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ef4cce8d-1fb5-4d1a-ad52-47820e9e626f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:01.267918 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ef4cce8d-1fb5-4d1a-ad52-47820e9e626f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.289427 Jun 21 08:23:01.268756 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 490/914] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:00 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:02.287213 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-479f48fe-89a7-480a-a1ff-d549a43daeb1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:02.287987 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-479f48fe-89a7-480a-a1ff-d549a43daeb1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:02.295609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-479f48fe-89a7-480a-a1ff-d549a43daeb1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:02.296063 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-479f48fe-89a7-480a-a1ff-d549a43daeb1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:02.296862 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-479f48fe-89a7-480a-a1ff-d549a43daeb1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:02.297298 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-479f48fe-89a7-480a-a1ff-d549a43daeb1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:02.451304 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-479f48fe-89a7-480a-a1ff-d549a43daeb1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:02.460397 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-479f48fe-89a7-480a-a1ff-d549a43daeb1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:02.461898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-479f48fe-89a7-480a-a1ff-d549a43daeb1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:02.463380 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-479f48fe-89a7-480a-a1ff-d549a43daeb1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.180185 Jun 21 08:23:02.464013 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 425/915] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:02 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:03.484334 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9587c790-d2d5-4f35-b5a5-13a19ee9e145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:03.484968 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9587c790-d2d5-4f35-b5a5-13a19ee9e145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:03.492236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9587c790-d2d5-4f35-b5a5-13a19ee9e145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:03.492724 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9587c790-d2d5-4f35-b5a5-13a19ee9e145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:03.493484 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9587c790-d2d5-4f35-b5a5-13a19ee9e145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:03.493923 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9587c790-d2d5-4f35-b5a5-13a19ee9e145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:03.669911 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9587c790-d2d5-4f35-b5a5-13a19ee9e145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:03.681233 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9587c790-d2d5-4f35-b5a5-13a19ee9e145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:03.682863 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9587c790-d2d5-4f35-b5a5-13a19ee9e145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:03.684032 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9587c790-d2d5-4f35-b5a5-13a19ee9e145 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.205766 Jun 21 08:23:03.685165 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 491/916] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:03 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:04.703779 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b302748b-da49-4c1f-8457-924998a13dee tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:04.704608 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b302748b-da49-4c1f-8457-924998a13dee tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:04.711762 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b302748b-da49-4c1f-8457-924998a13dee tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:04.712318 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b302748b-da49-4c1f-8457-924998a13dee tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:04.713224 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b302748b-da49-4c1f-8457-924998a13dee tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:04.713717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b302748b-da49-4c1f-8457-924998a13dee tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:04.882401 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b302748b-da49-4c1f-8457-924998a13dee tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:04.893604 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b302748b-da49-4c1f-8457-924998a13dee tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:04.895142 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b302748b-da49-4c1f-8457-924998a13dee tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:04.896409 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b302748b-da49-4c1f-8457-924998a13dee tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1809 microversion: 2.20 time: 0.197735 Jun 21 08:23:04.897139 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 426/917] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:04 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:05.918352 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8809e3f9-8636-418e-8e50-430dd6200808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:05.918920 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8809e3f9-8636-418e-8e50-430dd6200808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:05.926756 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8809e3f9-8636-418e-8e50-430dd6200808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:05.926950 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8809e3f9-8636-418e-8e50-430dd6200808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:05.927652 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8809e3f9-8636-418e-8e50-430dd6200808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:05.928091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8809e3f9-8636-418e-8e50-430dd6200808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:06.067364 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8809e3f9-8636-418e-8e50-430dd6200808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:06.078121 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8809e3f9-8636-418e-8e50-430dd6200808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:06.079637 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8809e3f9-8636-418e-8e50-430dd6200808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:06.080859 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8809e3f9-8636-418e-8e50-430dd6200808 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1796 microversion: 2.20 time: 0.166580 Jun 21 08:23:06.081434 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 492/918] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:05 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1796 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:19.493193 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1398889113", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "networks": [{"uuid": "5173ea1b-6939-4f27-ba30-a33c0a2db708"}]}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:23:19.500579 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:19.501282 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=66 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:19.559398 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.network.neutron [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] validate_networks() for [('5173ea1b-6939-4f27-ba30-a33c0a2db708', None, None, None, None, None)] {{(pid=117548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:23:20.004421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Flavor limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:23:20.004867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Image limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:23:20.005326 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Flavor pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:23:20.005737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Image pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:23:20.006151 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:23:20.015251 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:20.015700 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:20.017116 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:20.018143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:20.036310 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Getting quotas for project e2c14f0f94af45b7b3117234993b591e. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:23:20.040350 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Getting quotas for user 2f7b0c3b933d4bb5adb01bec696eed0b and project e2c14f0f94af45b7b3117234993b591e. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:23:20.052856 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Going to run 1 instances... {{(pid=117548) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:23:20.055171 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:23:20.105341 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-88b32209-742d-4da2-a3b7-26e48d70cf3d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616003 Jun 21 08:23:20.106185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 427/919] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:23:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:23:20.117353 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fec9a599-a99e-4f39-b81c-b797779a4306 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:20.118102 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fec9a599-a99e-4f39-b81c-b797779a4306 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:20.121006 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=5 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:20.121796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=31 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:20.186193 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fec9a599-a99e-4f39-b81c-b797779a4306 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:20.195635 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fec9a599-a99e-4f39-b81c-b797779a4306 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1219 microversion: 2.1 time: 0.083108 Jun 21 08:23:20.196755 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 493/920] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:23:20 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:23:21.213676 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-86586c61-35a3-4083-8d83-cb8e4104defb tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:21.214355 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-86586c61-35a3-4083-8d83-cb8e4104defb tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:21.223554 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-86586c61-35a3-4083-8d83-cb8e4104defb tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:21.223987 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-86586c61-35a3-4083-8d83-cb8e4104defb tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:21.224750 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-86586c61-35a3-4083-8d83-cb8e4104defb tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:21.225185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-86586c61-35a3-4083-8d83-cb8e4104defb tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:21.296197 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-86586c61-35a3-4083-8d83-cb8e4104defb tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:21.305132 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-86586c61-35a3-4083-8d83-cb8e4104defb tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1277 microversion: 2.1 time: 0.095789 Jun 21 08:23:21.305825 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 428/921] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:23:21 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:23:22.323085 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-01afb9e3-217a-42d1-9817-41ae2e7db5ee tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:22.323695 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-01afb9e3-217a-42d1-9817-41ae2e7db5ee tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:22.330841 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01afb9e3-217a-42d1-9817-41ae2e7db5ee tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:22.331306 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01afb9e3-217a-42d1-9817-41ae2e7db5ee tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:22.332134 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01afb9e3-217a-42d1-9817-41ae2e7db5ee tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:22.332751 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-01afb9e3-217a-42d1-9817-41ae2e7db5ee tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:22.490039 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-01afb9e3-217a-42d1-9817-41ae2e7db5ee tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:22.494690 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-db2c170d-0411-4646-9b54-11ddd5f952b9 req-9e4f341a-ce58-4771-b9a1-de726b18697d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "146c869a-86bf-48a4-9779-8fdf2f919a56", "tag": "5289fb23-8cbb-4cf6-9c98-ff16adde86b0"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:23:22.500347 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-01afb9e3-217a-42d1-9817-41ae2e7db5ee tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1319 microversion: 2.1 time: 0.181114 Jun 21 08:23:22.501426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 494/922] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:23:22 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:23:22.512695 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-db2c170d-0411-4646-9b54-11ddd5f952b9 req-9e4f341a-ce58-4771-b9a1-de726b18697d service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:22.512695 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-db2c170d-0411-4646-9b54-11ddd5f952b9 req-9e4f341a-ce58-4771-b9a1-de726b18697d service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:22.535163 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-db2c170d-0411-4646-9b54-11ddd5f952b9 req-9e4f341a-ce58-4771-b9a1-de726b18697d service nova] Creating event network-changed:5289fb23-8cbb-4cf6-9c98-ff16adde86b0 for instance 146c869a-86bf-48a4-9779-8fdf2f919a56 on hv-cinder-83697 Jun 21 08:23:22.543089 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-db2c170d-0411-4646-9b54-11ddd5f952b9 req-9e4f341a-ce58-4771-b9a1-de726b18697d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051591 Jun 21 08:23:22.544162 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 429/923] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:23:23.520581 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f605b928-8743-47c6-ad0f-c3ba3f53f8c8 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:23.521230 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f605b928-8743-47c6-ad0f-c3ba3f53f8c8 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:23.527642 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f605b928-8743-47c6-ad0f-c3ba3f53f8c8 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:23.528080 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f605b928-8743-47c6-ad0f-c3ba3f53f8c8 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:23.528828 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f605b928-8743-47c6-ad0f-c3ba3f53f8c8 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:23.529257 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f605b928-8743-47c6-ad0f-c3ba3f53f8c8 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:23.672005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f605b928-8743-47c6-ad0f-c3ba3f53f8c8 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:23.680366 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f605b928-8743-47c6-ad0f-c3ba3f53f8c8 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1319 microversion: 2.1 time: 0.164091 Jun 21 08:23:23.680925 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 495/924] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:23:23 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:23:24.699239 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-573d0c3b-6e63-48d4-9d0d-06a7c0d0fd29 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:24.699942 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-573d0c3b-6e63-48d4-9d0d-06a7c0d0fd29 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:24.706850 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-573d0c3b-6e63-48d4-9d0d-06a7c0d0fd29 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:24.707315 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-573d0c3b-6e63-48d4-9d0d-06a7c0d0fd29 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:24.708084 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-573d0c3b-6e63-48d4-9d0d-06a7c0d0fd29 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:24.708517 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-573d0c3b-6e63-48d4-9d0d-06a7c0d0fd29 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:24.849219 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-573d0c3b-6e63-48d4-9d0d-06a7c0d0fd29 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:24.856564 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-573d0c3b-6e63-48d4-9d0d-06a7c0d0fd29 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1319 microversion: 2.1 time: 0.161765 Jun 21 08:23:24.857123 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 430/925] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:23:24 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:23:25.875107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-2c18f27f-2912-4ea7-bc52-af329b96063f tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:25.876398 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-2c18f27f-2912-4ea7-bc52-af329b96063f tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:25.884223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2c18f27f-2912-4ea7-bc52-af329b96063f tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:25.884951 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2c18f27f-2912-4ea7-bc52-af329b96063f tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:25.885935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2c18f27f-2912-4ea7-bc52-af329b96063f tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:25.886382 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2c18f27f-2912-4ea7-bc52-af329b96063f tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:26.069285 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2c18f27f-2912-4ea7-bc52-af329b96063f tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:26.076979 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-2c18f27f-2912-4ea7-bc52-af329b96063f tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1319 microversion: 2.1 time: 0.206960 Jun 21 08:23:26.077930 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 496/926] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:23:25 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:23:27.095713 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-27deb7a7-e4c7-4b38-88db-a8c5f68b6510 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:27.096333 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-27deb7a7-e4c7-4b38-88db-a8c5f68b6510 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:27.106723 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-27deb7a7-e4c7-4b38-88db-a8c5f68b6510 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:27.107358 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-27deb7a7-e4c7-4b38-88db-a8c5f68b6510 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:27.108436 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-27deb7a7-e4c7-4b38-88db-a8c5f68b6510 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:27.108991 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-27deb7a7-e4c7-4b38-88db-a8c5f68b6510 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:27.339891 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-27deb7a7-e4c7-4b38-88db-a8c5f68b6510 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:27.348950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-27deb7a7-e4c7-4b38-88db-a8c5f68b6510 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1319 microversion: 2.1 time: 0.258494 Jun 21 08:23:27.349619 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 431/927] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:23:27 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:23:27.960162 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-bdc769e3-aefa-41d1-bf1c-c429c3fcb40b req-25a7a6d5-8dbf-470d-8e09-b39d5388465a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146c869a-86bf-48a4-9779-8fdf2f919a56", "name": "network-vif-plugged", "status": "completed", "tag": "5289fb23-8cbb-4cf6-9c98-ff16adde86b0"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:23:27.971033 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-bdc769e3-aefa-41d1-bf1c-c429c3fcb40b req-25a7a6d5-8dbf-470d-8e09-b39d5388465a service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:27.971705 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-bdc769e3-aefa-41d1-bf1c-c429c3fcb40b req-25a7a6d5-8dbf-470d-8e09-b39d5388465a service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:27.986649 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-bdc769e3-aefa-41d1-bf1c-c429c3fcb40b req-25a7a6d5-8dbf-470d-8e09-b39d5388465a service nova] Creating event network-vif-plugged:5289fb23-8cbb-4cf6-9c98-ff16adde86b0 for instance 146c869a-86bf-48a4-9779-8fdf2f919a56 on hv-cinder-83697 Jun 21 08:23:27.993236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-bdc769e3-aefa-41d1-bf1c-c429c3fcb40b req-25a7a6d5-8dbf-470d-8e09-b39d5388465a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037130 Jun 21 08:23:27.993860 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 497/928] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:23:28.367941 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-eb958179-cd43-4771-b329-98e9f914121a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:28.368543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-eb958179-cd43-4771-b329-98e9f914121a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:28.375129 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-eb958179-cd43-4771-b329-98e9f914121a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:28.375578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-eb958179-cd43-4771-b329-98e9f914121a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:28.376777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-eb958179-cd43-4771-b329-98e9f914121a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:28.376777 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-eb958179-cd43-4771-b329-98e9f914121a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:28.518989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-eb958179-cd43-4771-b329-98e9f914121a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:28.528556 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-eb958179-cd43-4771-b329-98e9f914121a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1319 microversion: 2.1 time: 0.165152 Jun 21 08:23:28.529271 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 432/929] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:23:28 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:23:29.546726 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-db6210bc-9541-4460-b2ea-be4293066eed tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:29.547830 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-db6210bc-9541-4460-b2ea-be4293066eed tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:29.556069 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db6210bc-9541-4460-b2ea-be4293066eed tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:29.556526 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db6210bc-9541-4460-b2ea-be4293066eed tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:29.557307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db6210bc-9541-4460-b2ea-be4293066eed tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:29.557926 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-db6210bc-9541-4460-b2ea-be4293066eed tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:29.699805 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-db6210bc-9541-4460-b2ea-be4293066eed tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:29.707410 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-db6210bc-9541-4460-b2ea-be4293066eed tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1508 microversion: 2.1 time: 0.165319 Jun 21 08:23:29.707975 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 498/930] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:23:29 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:23:38.850264 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-190d5846-1cb7-419e-9a66-b12140384db3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:38.851085 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-190d5846-1cb7-419e-9a66-b12140384db3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:38.853193 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:38.854247 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=6 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:38.855093 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:38.855826 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=28 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:38.862688 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-190d5846-1cb7-419e-9a66-b12140384db3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:38.863131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-190d5846-1cb7-419e-9a66-b12140384db3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:38.863906 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-190d5846-1cb7-419e-9a66-b12140384db3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:38.864329 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-190d5846-1cb7-419e-9a66-b12140384db3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:38.895119 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-190d5846-1cb7-419e-9a66-b12140384db3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-volume_attachments/957e3e2d-4d4d-42db-a7d1-463624031058" status: 200 len: 194 microversion: 2.20 time: 0.049595 Jun 21 08:23:38.896267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 433/931] 10.222.0.36 () {60 vars in 1453 bytes} [Tue Jun 21 08:23:38 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-volume_attachments/957e3e2d-4d4d-42db-a7d1-463624031058 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:23:38.964590 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5c3df4d0-4c4c-4f4a-86e0-76655fa6226c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:38.964590 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5c3df4d0-4c4c-4f4a-86e0-76655fa6226c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:38.966080 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:38.968873 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c3df4d0-4c4c-4f4a-86e0-76655fa6226c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:38.969328 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c3df4d0-4c4c-4f4a-86e0-76655fa6226c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:38.970099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c3df4d0-4c4c-4f4a-86e0-76655fa6226c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:38.970533 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5c3df4d0-4c4c-4f4a-86e0-76655fa6226c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:39.055304 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-5c3df4d0-4c4c-4f4a-86e0-76655fa6226c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lazy-loading 'services' on Instance uuid c679db4c-d2f2-4b89-8027-39078f9bf5aa {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:23:39.133527 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5c3df4d0-4c4c-4f4a-86e0-76655fa6226c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-volume_attachments/957e3e2d-4d4d-42db-a7d1-463624031058" status: 202 len: 0 microversion: 2.20 time: 0.176616 Jun 21 08:23:39.134170 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 499/932] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Jun 21 08:23:38 2022] DELETE /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-volume_attachments/957e3e2d-4d4d-42db-a7d1-463624031058 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:23:39.142802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1ed3c48e-0b79-4f5c-b3ad-927814d737bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:39.150179 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1ed3c48e-0b79-4f5c-b3ad-927814d737bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:39.150449 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ed3c48e-0b79-4f5c-b3ad-927814d737bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:39.150955 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ed3c48e-0b79-4f5c-b3ad-927814d737bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:39.151819 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ed3c48e-0b79-4f5c-b3ad-927814d737bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:39.153966 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1ed3c48e-0b79-4f5c-b3ad-927814d737bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:39.184296 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1ed3c48e-0b79-4f5c-b3ad-927814d737bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045562 Jun 21 08:23:39.185036 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 434/933] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 21 08:23:39 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:23:40.199080 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e69855ba-620c-4756-90ca-75d588e0a491 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:40.200099 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e69855ba-620c-4756-90ca-75d588e0a491 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:40.206319 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e69855ba-620c-4756-90ca-75d588e0a491 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:40.206816 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e69855ba-620c-4756-90ca-75d588e0a491 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:40.207584 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e69855ba-620c-4756-90ca-75d588e0a491 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:40.208018 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e69855ba-620c-4756-90ca-75d588e0a491 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:40.237812 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e69855ba-620c-4756-90ca-75d588e0a491 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043549 Jun 21 08:23:40.238372 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 500/934] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 21 08:23:40 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:23:40.298520 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-6ebd10a6-6d58-4a0c-9bbb-f39d53e34cbd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:40.299187 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6ebd10a6-6d58-4a0c-9bbb-f39d53e34cbd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:40.306526 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6ebd10a6-6d58-4a0c-9bbb-f39d53e34cbd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:40.307052 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6ebd10a6-6d58-4a0c-9bbb-f39d53e34cbd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:40.307886 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6ebd10a6-6d58-4a0c-9bbb-f39d53e34cbd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:40.308411 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-6ebd10a6-6d58-4a0c-9bbb-f39d53e34cbd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:40.335976 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-6ebd10a6-6d58-4a0c-9bbb-f39d53e34cbd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:23:40.431356 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-6ebd10a6-6d58-4a0c-9bbb-f39d53e34cbd tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 204 len: 0 microversion: 2.20 time: 0.135920 Jun 21 08:23:40.432104 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 435/935] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 21 08:23:40 2022] DELETE /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 08:23:40.440436 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-31bc6041-43fa-4b07-8517-17fbc0e471b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:40.441053 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-31bc6041-43fa-4b07-8517-17fbc0e471b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:40.449371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31bc6041-43fa-4b07-8517-17fbc0e471b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:40.449823 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31bc6041-43fa-4b07-8517-17fbc0e471b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:40.451309 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31bc6041-43fa-4b07-8517-17fbc0e471b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:40.452191 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31bc6041-43fa-4b07-8517-17fbc0e471b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:40.598111 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-31bc6041-43fa-4b07-8517-17fbc0e471b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:40.606317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-31bc6041-43fa-4b07-8517-17fbc0e471b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:40.607860 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-31bc6041-43fa-4b07-8517-17fbc0e471b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:40.609011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-31bc6041-43fa-4b07-8517-17fbc0e471b6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.172490 Jun 21 08:23:40.609571 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 501/936] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:40 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:23:41.634204 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-88f8c4b7-3eff-4db0-88a6-b118ffeb318d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:41.634935 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-88f8c4b7-3eff-4db0-88a6-b118ffeb318d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:41.641740 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88f8c4b7-3eff-4db0-88a6-b118ffeb318d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:41.642181 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88f8c4b7-3eff-4db0-88a6-b118ffeb318d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:41.642979 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88f8c4b7-3eff-4db0-88a6-b118ffeb318d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:41.643407 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88f8c4b7-3eff-4db0-88a6-b118ffeb318d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:41.790080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-88f8c4b7-3eff-4db0-88a6-b118ffeb318d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:41.799098 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-88f8c4b7-3eff-4db0-88a6-b118ffeb318d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:41.800788 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-88f8c4b7-3eff-4db0-88a6-b118ffeb318d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:41.802753 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-88f8c4b7-3eff-4db0-88a6-b118ffeb318d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1724 microversion: 2.20 time: 0.172722 Jun 21 08:23:41.803808 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 436/937] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:41 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:42.822594 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ce327453-3a1a-414e-a34a-2abbafca5451 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:42.823269 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ce327453-3a1a-414e-a34a-2abbafca5451 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:42.830433 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ce327453-3a1a-414e-a34a-2abbafca5451 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:42.831043 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ce327453-3a1a-414e-a34a-2abbafca5451 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:42.831827 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ce327453-3a1a-414e-a34a-2abbafca5451 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:42.832256 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ce327453-3a1a-414e-a34a-2abbafca5451 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:42.906128 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ce327453-3a1a-414e-a34a-2abbafca5451 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:42.915645 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ce327453-3a1a-414e-a34a-2abbafca5451 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:42.917167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ce327453-3a1a-414e-a34a-2abbafca5451 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:42.918345 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ce327453-3a1a-414e-a34a-2abbafca5451 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 200 len: 1656 microversion: 2.20 time: 0.100776 Jun 21 08:23:42.918946 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 502/938] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:42 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:43.059117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-083a953f-7747-4e3a-8691-c6135f157704 req-4fdc7de6-5fa3-4bfe-b30b-14f3b3888ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c679db4c-d2f2-4b89-8027-39078f9bf5aa", "name": "network-vif-deleted", "tag": "cf45f811-be66-426a-b1e5-e7bddc45e9f0"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:23:43.069899 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-083a953f-7747-4e3a-8691-c6135f157704 req-4fdc7de6-5fa3-4bfe-b30b-14f3b3888ceb service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:43.070350 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-083a953f-7747-4e3a-8691-c6135f157704 req-4fdc7de6-5fa3-4bfe-b30b-14f3b3888ceb service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:43.101726 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-083a953f-7747-4e3a-8691-c6135f157704 req-4fdc7de6-5fa3-4bfe-b30b-14f3b3888ceb service nova] Creating event network-vif-deleted:cf45f811-be66-426a-b1e5-e7bddc45e9f0 for instance c679db4c-d2f2-4b89-8027-39078f9bf5aa on hv-cinder-83697 Jun 21 08:23:43.104668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-083a953f-7747-4e3a-8691-c6135f157704 req-4fdc7de6-5fa3-4bfe-b30b-14f3b3888ceb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049249 Jun 21 08:23:43.105897 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 437/939] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:23:43.937363 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ef61b445-79ac-4af8-a289-e8c2377dae2e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:43.937977 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ef61b445-79ac-4af8-a289-e8c2377dae2e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:43.947089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef61b445-79ac-4af8-a289-e8c2377dae2e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:43.947536 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef61b445-79ac-4af8-a289-e8c2377dae2e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:43.948303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef61b445-79ac-4af8-a289-e8c2377dae2e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:43.948735 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ef61b445-79ac-4af8-a289-e8c2377dae2e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:43.964087 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-ef61b445-79ac-4af8-a289-e8c2377dae2e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] HTTP exception thrown: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ef61b445-79ac-4af8-a289-e8c2377dae2e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Request method failure captured: Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa HTTP/1.1 Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX92Qos4PjD4nrb9Z-KMrynfFbiGinrocNE8y8creAPk98nGSUgNkMhTFfREXCAaFbYBYGmBW9F3klfN0MnLDZvJ0aDwfKrxSgc2dEwcpw-zdm9f22FSP0d8K32MZ_P0xzgEc5EWmjO6zeLGGjWCsaGmsCGxHJ4CmhIRW2YMFKCU-d4 Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:23:43.965915 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_df68cafb6dcd4a8c9e9593d3f13500f0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 2bc6e732127845a6be56f9b8be728f14 Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:23:43.967752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'c679db4c-d2f2-4b89-8027-39078f9bf5aa'} Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:23:43.968688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:23:43.970314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:23:43.971740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ef61b445-79ac-4af8-a289-e8c2377dae2e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Returning 404 to user: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:23:43.971740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ef61b445-79ac-4af8-a289-e8c2377dae2e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 404 len: 111 microversion: 2.20 time: 0.033869 Jun 21 08:23:43.971740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 503/940] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:43 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 08:23:43.978606 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-12a8ce50-d149-40b8-9f3c-e7bcbc040295 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '.version_select at 0x7fded2e3cee0>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:44.003151 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-12a8ce50-d149-40b8-9f3c-e7bcbc040295 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553355533" status: 204 len: 0 microversion: 2.20 time: 0.030302 Jun 21 08:23:44.004190 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 438/941] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Jun 21 08:23:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553355533 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 08:23:44.713870 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a0878fa4-b7f5-4cce-9413-6023523b4c2f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Action: 'create', calling method: .version_select at 0x7fded2db9c10>, body: {"keypair": {"name": "tempest-keypair-1028437079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfwOHcUTaORmG8qGG7i9oC/1JtigwN6jXwRHdZWdGYqKbVhnFHI18AFJgTTEzWztve3GIDYEfxJSJtkuty5isz4CRzK6wEbfC0wmXYDG2rf/hy9QBOO/PWfPccGmFeu6g=="}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:23:44.728145 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-a0878fa4-b7f5-4cce-9413-6023523b4c2f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Getting quotas for project df68cafb6dcd4a8c9e9593d3f13500f0. Resources: {'key_pairs'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:23:44.731881 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-a0878fa4-b7f5-4cce-9413-6023523b4c2f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Getting quotas for user 2bc6e732127845a6be56f9b8be728f14 and project df68cafb6dcd4a8c9e9593d3f13500f0. Resources: {'key_pairs'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:23:44.756574 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a0878fa4-b7f5-4cce-9413-6023523b4c2f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046005 Jun 21 08:23:44.757185 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 504/942] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Jun 21 08:23:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 08:23:44.922426 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b05dd854-25b3-4998-854a-3216bbc6e267 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18868df2-a10c-4e2b-bc28-0f2b7934bbfc", "device": "/dev/sdb"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:23:44.924221 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b05dd854-25b3-4998-854a-3216bbc6e267 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:44.933619 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b05dd854-25b3-4998-854a-3216bbc6e267 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:44.933998 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b05dd854-25b3-4998-854a-3216bbc6e267 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:44.934820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b05dd854-25b3-4998-854a-3216bbc6e267 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:44.935259 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b05dd854-25b3-4998-854a-3216bbc6e267 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:45.196070 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b05dd854-25b3-4998-854a-3216bbc6e267 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "POST /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277909 Jun 21 08:23:45.197463 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 439/943] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:23:44 2022] POST /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:23:46.124654 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1532022273", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "024039b9-9413-4bce-aeef-0421349b4da5"}], "security_groups": [{"name": "tempest-securitygroup--1013796990"}], "key_name": "tempest-keypair-1028437079", "user_data": "}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:23:46.227874 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] validate_networks() for [('024039b9-9413-4bce-aeef-0421349b4da5', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:23:46.619970 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:23:46.620449 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:23:46.620924 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:23:46.621335 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:23:46.621745 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:23:46.632100 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:46.632554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:46.633352 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:46.633788 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:46.651570 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Getting quotas for project df68cafb6dcd4a8c9e9593d3f13500f0. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:23:46.655571 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Getting quotas for user 2bc6e732127845a6be56f9b8be728f14 and project df68cafb6dcd4a8c9e9593d3f13500f0. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:23:46.667364 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:23:46.669627 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:23:46.718966 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-82be9624-191b-4df4-b133-cabad4fc0136 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.598983 Jun 21 08:23:46.722205 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 505/944] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Jun 21 08:23:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 08:23:46.731008 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-35565753-b134-4ea6-bcd8-099a1cd22e99 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:46.731717 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-35565753-b134-4ea6-bcd8-099a1cd22e99 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:46.790343 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-35565753-b134-4ea6-bcd8-099a1cd22e99 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:46.798166 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-35565753-b134-4ea6-bcd8-099a1cd22e99 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:46.799750 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-35565753-b134-4ea6-bcd8-099a1cd22e99 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:46.800903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-35565753-b134-4ea6-bcd8-099a1cd22e99 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1282 microversion: 2.20 time: 0.074277 Jun 21 08:23:46.801475 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 440/945] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:46 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:47.821107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e1c8081c-40a4-4ffd-b670-4677aae95532 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:47.821669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e1c8081c-40a4-4ffd-b670-4677aae95532 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:47.829025 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e1c8081c-40a4-4ffd-b670-4677aae95532 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:47.829465 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e1c8081c-40a4-4ffd-b670-4677aae95532 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:47.830437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e1c8081c-40a4-4ffd-b670-4677aae95532 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:47.830906 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e1c8081c-40a4-4ffd-b670-4677aae95532 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:47.921868 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e1c8081c-40a4-4ffd-b670-4677aae95532 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:47.930260 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e1c8081c-40a4-4ffd-b670-4677aae95532 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:47.931819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e1c8081c-40a4-4ffd-b670-4677aae95532 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:47.932998 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e1c8081c-40a4-4ffd-b670-4677aae95532 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1334 microversion: 2.20 time: 0.117237 Jun 21 08:23:47.933563 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 506/946] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:47 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1334 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:23:48.952169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4b00cc29-696c-4cc1-9d4f-978fe7c603f1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:48.952944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4b00cc29-696c-4cc1-9d4f-978fe7c603f1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:48.961326 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4b00cc29-696c-4cc1-9d4f-978fe7c603f1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:48.961779 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4b00cc29-696c-4cc1-9d4f-978fe7c603f1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:48.962588 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4b00cc29-696c-4cc1-9d4f-978fe7c603f1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:48.963063 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4b00cc29-696c-4cc1-9d4f-978fe7c603f1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:49.177840 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4b00cc29-696c-4cc1-9d4f-978fe7c603f1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:49.186162 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4b00cc29-696c-4cc1-9d4f-978fe7c603f1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:49.187714 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4b00cc29-696c-4cc1-9d4f-978fe7c603f1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:49.188847 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4b00cc29-696c-4cc1-9d4f-978fe7c603f1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.240801 Jun 21 08:23:49.189408 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 441/947] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:48 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:49.475967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-2d41d701-fc1b-45d1-bef4-af061413dbd5 req-1b8fb615-b253-4a5b-978e-e12f419e1f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fda813-f341-4923-a4f9-5025f6790375", "tag": "1d991028-ab62-4ec9-81b9-b98c925870ae"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:23:49.485595 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-2d41d701-fc1b-45d1-bef4-af061413dbd5 req-1b8fb615-b253-4a5b-978e-e12f419e1f53 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:49.491589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-2d41d701-fc1b-45d1-bef4-af061413dbd5 req-1b8fb615-b253-4a5b-978e-e12f419e1f53 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:49.507685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-2d41d701-fc1b-45d1-bef4-af061413dbd5 req-1b8fb615-b253-4a5b-978e-e12f419e1f53 service nova] Creating event network-changed:1d991028-ab62-4ec9-81b9-b98c925870ae for instance b5fda813-f341-4923-a4f9-5025f6790375 on hv-cinder-83697 Jun 21 08:23:49.512576 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-2d41d701-fc1b-45d1-bef4-af061413dbd5 req-1b8fb615-b253-4a5b-978e-e12f419e1f53 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046158 Jun 21 08:23:49.513563 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 507/948] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:23:50.207784 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-356b5594-6758-423d-9f8b-b7cf295c39ed tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:50.208389 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-356b5594-6758-423d-9f8b-b7cf295c39ed tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:50.215467 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-356b5594-6758-423d-9f8b-b7cf295c39ed tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:50.215916 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-356b5594-6758-423d-9f8b-b7cf295c39ed tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:50.216672 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-356b5594-6758-423d-9f8b-b7cf295c39ed tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:50.217102 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-356b5594-6758-423d-9f8b-b7cf295c39ed tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:50.350442 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-356b5594-6758-423d-9f8b-b7cf295c39ed tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:50.359114 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-356b5594-6758-423d-9f8b-b7cf295c39ed tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:50.360607 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-356b5594-6758-423d-9f8b-b7cf295c39ed tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:50.361820 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-356b5594-6758-423d-9f8b-b7cf295c39ed tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.157921 Jun 21 08:23:50.362396 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 442/949] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:50 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:23:51.382187 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f06d24bd-908e-4341-92e7-3e04c35812bc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:51.383129 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f06d24bd-908e-4341-92e7-3e04c35812bc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:51.385201 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:51.392288 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f06d24bd-908e-4341-92e7-3e04c35812bc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:51.392829 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f06d24bd-908e-4341-92e7-3e04c35812bc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:51.393623 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f06d24bd-908e-4341-92e7-3e04c35812bc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:51.394096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f06d24bd-908e-4341-92e7-3e04c35812bc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:51.398921 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:51.564601 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f06d24bd-908e-4341-92e7-3e04c35812bc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:51.578488 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f06d24bd-908e-4341-92e7-3e04c35812bc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:51.580180 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f06d24bd-908e-4341-92e7-3e04c35812bc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:51.581386 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f06d24bd-908e-4341-92e7-3e04c35812bc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.204933 Jun 21 08:23:51.582023 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 508/950] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:51 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:23:52.600900 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-03695be4-8c43-429f-a6f1-69885a1f3f58 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:52.601517 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-03695be4-8c43-429f-a6f1-69885a1f3f58 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:52.608594 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-03695be4-8c43-429f-a6f1-69885a1f3f58 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:52.609082 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-03695be4-8c43-429f-a6f1-69885a1f3f58 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:52.609853 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-03695be4-8c43-429f-a6f1-69885a1f3f58 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:52.610291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-03695be4-8c43-429f-a6f1-69885a1f3f58 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:52.747826 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-03695be4-8c43-429f-a6f1-69885a1f3f58 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:52.756170 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-03695be4-8c43-429f-a6f1-69885a1f3f58 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:52.757753 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-03695be4-8c43-429f-a6f1-69885a1f3f58 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:52.758910 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-03695be4-8c43-429f-a6f1-69885a1f3f58 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.162048 Jun 21 08:23:52.759482 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 443/951] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:52 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:53.777856 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-fb651d46-8060-4fdb-b3d6-dcad09d7c35c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:53.778522 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-fb651d46-8060-4fdb-b3d6-dcad09d7c35c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:53.785428 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fb651d46-8060-4fdb-b3d6-dcad09d7c35c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:53.785907 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fb651d46-8060-4fdb-b3d6-dcad09d7c35c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:53.786715 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fb651d46-8060-4fdb-b3d6-dcad09d7c35c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:53.787252 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-fb651d46-8060-4fdb-b3d6-dcad09d7c35c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:53.924098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fb651d46-8060-4fdb-b3d6-dcad09d7c35c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:53.933501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fb651d46-8060-4fdb-b3d6-dcad09d7c35c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:53.935092 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-fb651d46-8060-4fdb-b3d6-dcad09d7c35c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:53.936200 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-fb651d46-8060-4fdb-b3d6-dcad09d7c35c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.162470 Jun 21 08:23:53.936752 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 509/952] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:53 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:54.955575 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-093d098e-b369-4a0d-b8d9-bac90fd4dd8f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:54.956231 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-093d098e-b369-4a0d-b8d9-bac90fd4dd8f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:54.964746 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-093d098e-b369-4a0d-b8d9-bac90fd4dd8f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:54.965095 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-093d098e-b369-4a0d-b8d9-bac90fd4dd8f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:54.966027 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-093d098e-b369-4a0d-b8d9-bac90fd4dd8f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:54.966349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-093d098e-b369-4a0d-b8d9-bac90fd4dd8f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:55.126031 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-093d098e-b369-4a0d-b8d9-bac90fd4dd8f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:55.143324 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-093d098e-b369-4a0d-b8d9-bac90fd4dd8f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:55.145645 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-093d098e-b369-4a0d-b8d9-bac90fd4dd8f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:55.147801 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-093d098e-b369-4a0d-b8d9-bac90fd4dd8f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.196146 Jun 21 08:23:55.149015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 444/953] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:54 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:56.166679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9c01237c-8f41-4954-8735-f64cdd80cdd9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:56.167753 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9c01237c-8f41-4954-8735-f64cdd80cdd9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:56.173879 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c01237c-8f41-4954-8735-f64cdd80cdd9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:56.174327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c01237c-8f41-4954-8735-f64cdd80cdd9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:56.175125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c01237c-8f41-4954-8735-f64cdd80cdd9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:56.175558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c01237c-8f41-4954-8735-f64cdd80cdd9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:56.319266 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9c01237c-8f41-4954-8735-f64cdd80cdd9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:56.327433 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9c01237c-8f41-4954-8735-f64cdd80cdd9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:56.328851 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9c01237c-8f41-4954-8735-f64cdd80cdd9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:56.329973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9c01237c-8f41-4954-8735-f64cdd80cdd9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.167265 Jun 21 08:23:56.330530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 510/954] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:56 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:57.348152 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2372f630-d70e-479e-aa49-4e7093ee7d04 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:57.348770 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2372f630-d70e-479e-aa49-4e7093ee7d04 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:57.351341 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:57.356956 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2372f630-d70e-479e-aa49-4e7093ee7d04 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:57.357408 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2372f630-d70e-479e-aa49-4e7093ee7d04 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:57.358231 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2372f630-d70e-479e-aa49-4e7093ee7d04 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:57.358698 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2372f630-d70e-479e-aa49-4e7093ee7d04 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:57.492284 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2372f630-d70e-479e-aa49-4e7093ee7d04 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:57.500287 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2372f630-d70e-479e-aa49-4e7093ee7d04 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:57.501805 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2372f630-d70e-479e-aa49-4e7093ee7d04 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:57.502950 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2372f630-d70e-479e-aa49-4e7093ee7d04 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.158798 Jun 21 08:23:57.503515 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 445/955] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:57 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:58.324159 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-6af115c4-ea70-4c6b-b828-df8dab7d709d req-de1deedb-1602-4bad-9b68-cc795ee1bdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fda813-f341-4923-a4f9-5025f6790375", "name": "network-vif-plugged", "status": "completed", "tag": "1d991028-ab62-4ec9-81b9-b98c925870ae"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:23:58.327921 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:58.328890 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=10 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:58.341974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-6af115c4-ea70-4c6b-b828-df8dab7d709d req-de1deedb-1602-4bad-9b68-cc795ee1bdc4 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:58.342522 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-6af115c4-ea70-4c6b-b828-df8dab7d709d req-de1deedb-1602-4bad-9b68-cc795ee1bdc4 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:58.364620 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-6af115c4-ea70-4c6b-b828-df8dab7d709d req-de1deedb-1602-4bad-9b68-cc795ee1bdc4 service nova] Creating event network-vif-plugged:1d991028-ab62-4ec9-81b9-b98c925870ae for instance b5fda813-f341-4923-a4f9-5025f6790375 on hv-cinder-83697 Jun 21 08:23:58.373091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-6af115c4-ea70-4c6b-b828-df8dab7d709d req-de1deedb-1602-4bad-9b68-cc795ee1bdc4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051982 Jun 21 08:23:58.374164 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 511/956] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:23:58.526419 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-50e9972d-9001-4af7-817f-f57a218e2b22 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:58.527061 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-50e9972d-9001-4af7-817f-f57a218e2b22 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:58.534207 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-50e9972d-9001-4af7-817f-f57a218e2b22 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:58.534683 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-50e9972d-9001-4af7-817f-f57a218e2b22 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:58.535460 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-50e9972d-9001-4af7-817f-f57a218e2b22 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:58.535894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-50e9972d-9001-4af7-817f-f57a218e2b22 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:58.753001 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-50e9972d-9001-4af7-817f-f57a218e2b22 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:58.763657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-50e9972d-9001-4af7-817f-f57a218e2b22 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:58.765485 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-50e9972d-9001-4af7-817f-f57a218e2b22 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:58.766883 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-50e9972d-9001-4af7-817f-f57a218e2b22 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.245395 Jun 21 08:23:58.767471 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 446/957] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:58 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:23:59.787207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-85e27908-af72-43e9-878d-c5d966ab099f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:23:59.788556 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-85e27908-af72-43e9-878d-c5d966ab099f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:23:59.795646 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85e27908-af72-43e9-878d-c5d966ab099f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:59.796231 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85e27908-af72-43e9-878d-c5d966ab099f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:59.797525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85e27908-af72-43e9-878d-c5d966ab099f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:23:59.798224 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-85e27908-af72-43e9-878d-c5d966ab099f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:23:59.953005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-85e27908-af72-43e9-878d-c5d966ab099f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:59.962808 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-85e27908-af72-43e9-878d-c5d966ab099f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:59.964303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-85e27908-af72-43e9-878d-c5d966ab099f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:23:59.965423 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-85e27908-af72-43e9-878d-c5d966ab099f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.183348 Jun 21 08:23:59.965988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 512/958] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:23:59 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:00.986749 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9ff2f0e3-cd9d-408a-ad5d-9369cb0a7823 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:00.987365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-9ff2f0e3-cd9d-408a-ad5d-9369cb0a7823 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:00.994676 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9ff2f0e3-cd9d-408a-ad5d-9369cb0a7823 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:00.995131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9ff2f0e3-cd9d-408a-ad5d-9369cb0a7823 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:00.995904 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9ff2f0e3-cd9d-408a-ad5d-9369cb0a7823 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:00.996335 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-9ff2f0e3-cd9d-408a-ad5d-9369cb0a7823 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:01.125232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-9ff2f0e3-cd9d-408a-ad5d-9369cb0a7823 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:01.133535 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-9ff2f0e3-cd9d-408a-ad5d-9369cb0a7823 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:01.135080 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-9ff2f0e3-cd9d-408a-ad5d-9369cb0a7823 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:01.136197 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9ff2f0e3-cd9d-408a-ad5d-9369cb0a7823 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.153444 Jun 21 08:24:01.136752 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 447/959] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:00 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:02.154073 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-53aae97a-dfaa-4439-970c-e80b52b5a1dc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:02.154743 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-53aae97a-dfaa-4439-970c-e80b52b5a1dc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:02.161167 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-53aae97a-dfaa-4439-970c-e80b52b5a1dc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:02.161607 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-53aae97a-dfaa-4439-970c-e80b52b5a1dc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:02.162357 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-53aae97a-dfaa-4439-970c-e80b52b5a1dc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:02.163497 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-53aae97a-dfaa-4439-970c-e80b52b5a1dc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:02.304660 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-53aae97a-dfaa-4439-970c-e80b52b5a1dc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:02.312732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-53aae97a-dfaa-4439-970c-e80b52b5a1dc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:02.314221 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-53aae97a-dfaa-4439-970c-e80b52b5a1dc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:02.315355 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-53aae97a-dfaa-4439-970c-e80b52b5a1dc tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1408 microversion: 2.20 time: 0.165296 Jun 21 08:24:02.315919 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 513/960] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:02 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:03.334042 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-691ea4f6-3182-48d7-9f1f-4c07d08c69d7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:03.334798 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-691ea4f6-3182-48d7-9f1f-4c07d08c69d7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:03.341805 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-691ea4f6-3182-48d7-9f1f-4c07d08c69d7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:03.342258 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-691ea4f6-3182-48d7-9f1f-4c07d08c69d7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:03.343062 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-691ea4f6-3182-48d7-9f1f-4c07d08c69d7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:03.343504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-691ea4f6-3182-48d7-9f1f-4c07d08c69d7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:03.483084 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-691ea4f6-3182-48d7-9f1f-4c07d08c69d7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:03.492238 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-691ea4f6-3182-48d7-9f1f-4c07d08c69d7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:03.493747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-691ea4f6-3182-48d7-9f1f-4c07d08c69d7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:03.495005 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-691ea4f6-3182-48d7-9f1f-4c07d08c69d7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1600 microversion: 2.20 time: 0.164881 Jun 21 08:24:03.496728 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 448/961] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:03 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:03.514213 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-df776f5c-af8b-4c32-ac6f-ec17c24ada52 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:03.514780 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-df776f5c-af8b-4c32-ac6f-ec17c24ada52 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:03.520910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-df776f5c-af8b-4c32-ac6f-ec17c24ada52 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:03.521364 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-df776f5c-af8b-4c32-ac6f-ec17c24ada52 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:03.522136 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-df776f5c-af8b-4c32-ac6f-ec17c24ada52 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:03.522575 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-df776f5c-af8b-4c32-ac6f-ec17c24ada52 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:03.606666 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-df776f5c-af8b-4c32-ac6f-ec17c24ada52 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096460 Jun 21 08:24:03.607444 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 514/962] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Jun 21 08:24:03 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:24:04.817468 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-05947a0f-12fb-4d96-8f09-8bec6fc85deb req-d31069fd-078a-4c98-99ba-3a15e74423bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fda813-f341-4923-a4f9-5025f6790375", "tag": "1d991028-ab62-4ec9-81b9-b98c925870ae"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:24:04.828879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-05947a0f-12fb-4d96-8f09-8bec6fc85deb req-d31069fd-078a-4c98-99ba-3a15e74423bc service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:04.829320 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-05947a0f-12fb-4d96-8f09-8bec6fc85deb req-d31069fd-078a-4c98-99ba-3a15e74423bc service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:04.833141 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:04.841871 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-05947a0f-12fb-4d96-8f09-8bec6fc85deb req-d31069fd-078a-4c98-99ba-3a15e74423bc service nova] Creating event network-changed:1d991028-ab62-4ec9-81b9-b98c925870ae for instance b5fda813-f341-4923-a4f9-5025f6790375 on hv-cinder-83697 Jun 21 08:24:04.847146 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-05947a0f-12fb-4d96-8f09-8bec6fc85deb req-d31069fd-078a-4c98-99ba-3a15e74423bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035956 Jun 21 08:24:04.847785 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 449/963] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:24:04.959236 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-407f2202-fb9a-4a80-ae22-d97cedf8b97b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:04.960962 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-407f2202-fb9a-4a80-ae22-d97cedf8b97b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:04.966880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-407f2202-fb9a-4a80-ae22-d97cedf8b97b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:04.967662 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-407f2202-fb9a-4a80-ae22-d97cedf8b97b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:04.968553 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-407f2202-fb9a-4a80-ae22-d97cedf8b97b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:04.969096 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-407f2202-fb9a-4a80-ae22-d97cedf8b97b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:05.057505 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-407f2202-fb9a-4a80-ae22-d97cedf8b97b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lazy-loading 'services' on Instance uuid 146c869a-86bf-48a4-9779-8fdf2f919a56 {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:24:05.148865 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-407f2202-fb9a-4a80-ae22-d97cedf8b97b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "DELETE /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56/os-volume_attachments/18868df2-a10c-4e2b-bc28-0f2b7934bbfc" status: 202 len: 0 microversion: 2.1 time: 0.192548 Jun 21 08:24:05.150955 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 515/964] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:24:04 2022] DELETE /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56/os-volume_attachments/18868df2-a10c-4e2b-bc28-0f2b7934bbfc => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:24:06.284917 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a18374dc-c9a3-4392-8e54-579a2c77c3a2 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:06.285500 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a18374dc-c9a3-4392-8e54-579a2c77c3a2 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:06.293716 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a18374dc-c9a3-4392-8e54-579a2c77c3a2 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:06.294149 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a18374dc-c9a3-4392-8e54-579a2c77c3a2 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:06.294936 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a18374dc-c9a3-4392-8e54-579a2c77c3a2 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:06.295372 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a18374dc-c9a3-4392-8e54-579a2c77c3a2 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:06.324248 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a18374dc-c9a3-4392-8e54-579a2c77c3a2 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:24:06.400754 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a18374dc-c9a3-4392-8e54-579a2c77c3a2 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "DELETE /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 204 len: 0 microversion: 2.1 time: 0.120062 Jun 21 08:24:06.401561 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 450/965] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:24:06 2022] DELETE /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:24:06.410873 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-66c9d759-8c38-4556-857d-0f1c05c6bae9 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:06.411573 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-66c9d759-8c38-4556-857d-0f1c05c6bae9 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:06.418508 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-66c9d759-8c38-4556-857d-0f1c05c6bae9 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:06.419019 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-66c9d759-8c38-4556-857d-0f1c05c6bae9 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:06.419773 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-66c9d759-8c38-4556-857d-0f1c05c6bae9 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:06.420207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-66c9d759-8c38-4556-857d-0f1c05c6bae9 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:06.552689 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-66c9d759-8c38-4556-857d-0f1c05c6bae9 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:06.561165 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-66c9d759-8c38-4556-857d-0f1c05c6bae9 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1514 microversion: 2.1 time: 0.155014 Jun 21 08:24:06.561730 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 516/966] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:06 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:07.579024 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d72d995c-33af-42b5-b577-224bd85cd93a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:07.579726 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d72d995c-33af-42b5-b577-224bd85cd93a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:07.586237 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d72d995c-33af-42b5-b577-224bd85cd93a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:07.586710 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d72d995c-33af-42b5-b577-224bd85cd93a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:07.587465 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d72d995c-33af-42b5-b577-224bd85cd93a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:07.587892 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d72d995c-33af-42b5-b577-224bd85cd93a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:07.718225 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d72d995c-33af-42b5-b577-224bd85cd93a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:07.726280 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d72d995c-33af-42b5-b577-224bd85cd93a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1514 microversion: 2.1 time: 0.151463 Jun 21 08:24:07.726971 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 451/967] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:07 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:08.497593 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-3a6f12fb-9ebe-4345-bc35-9cc7880814e6 req-02d73044-26cf-4785-9285-29ab736c6bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146c869a-86bf-48a4-9779-8fdf2f919a56", "name": "network-vif-deleted", "tag": "5289fb23-8cbb-4cf6-9c98-ff16adde86b0"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:24:08.508358 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-3a6f12fb-9ebe-4345-bc35-9cc7880814e6 req-02d73044-26cf-4785-9285-29ab736c6bdb service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:08.508806 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-3a6f12fb-9ebe-4345-bc35-9cc7880814e6 req-02d73044-26cf-4785-9285-29ab736c6bdb service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:08.520825 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-3a6f12fb-9ebe-4345-bc35-9cc7880814e6 req-02d73044-26cf-4785-9285-29ab736c6bdb service nova] Creating event network-vif-deleted:5289fb23-8cbb-4cf6-9c98-ff16adde86b0 for instance 146c869a-86bf-48a4-9779-8fdf2f919a56 on hv-cinder-83697 Jun 21 08:24:08.526292 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-3a6f12fb-9ebe-4345-bc35-9cc7880814e6 req-02d73044-26cf-4785-9285-29ab736c6bdb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032557 Jun 21 08:24:08.526986 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 517/968] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:24:08.743344 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:08.744023 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:08.750747 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:08.751192 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:08.751975 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:08.752475 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:08.784430 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:08.784938 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:08.785376 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lazy-loading 'fault' on Instance uuid 146c869a-86bf-48a4-9779-8fdf2f919a56 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:24:08.827454 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:08.835406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d95da73e-3713-4c1a-84cd-3d7a32743b6a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 200 len: 1309 microversion: 2.1 time: 0.096034 Jun 21 08:24:08.836044 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 452/969] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:08 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:09.854449 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-cb777665-65d9-4d69-a45d-c5e4ff733282 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:09.855315 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-cb777665-65d9-4d69-a45d-c5e4ff733282 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 146c869a-86bf-48a4-9779-8fdf2f919a56] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:09.861483 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-cb777665-65d9-4d69-a45d-c5e4ff733282 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:09.861924 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-cb777665-65d9-4d69-a45d-c5e4ff733282 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:09.862746 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-cb777665-65d9-4d69-a45d-c5e4ff733282 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:09.863201 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-cb777665-65d9-4d69-a45d-c5e4ff733282 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:09.876432 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-cb777665-65d9-4d69-a45d-c5e4ff733282 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] HTTP exception thrown: Instance 146c869a-86bf-48a4-9779-8fdf2f919a56 could not be found. Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-cb777665-65d9-4d69-a45d-c5e4ff733282 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Request method failure captured: Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 HTTP/1.1 Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX_12rgTJ8sUfdrWwMj16o-t45JIcWr_e_Oes6r1Z2SaOGsmmetXl9jtxyH46C4VCZIYlW58CNgC7wtZRqcsfQ91kfxzWu1EEB_ev6nDEId02bExUFeh19pc2dbvq9UKJpAOIl-wbafsO0e5QClXOIflGcDqw6-EgUc5VQ38YUh3X4Q Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: e2c14f0f94af45b7b3117234993b591e Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-VolumesSnapshotTestJSON-714369247 Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:24:09.878027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2c14f0f94af45b7b3117234993b591e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e2c14f0f94af45b7b3117234993b591e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2c14f0f94af45b7b3117234993b591e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e2c14f0f94af45b7b3117234993b591e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-VolumesSnapshotTestJSON-714369247 Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: e2c14f0f94af45b7b3117234993b591e Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-714369247 Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-VolumesSnapshotTestJSON-714369247-project Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 2f7b0c3b933d4bb5adb01bec696eed0b Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-VolumesSnapshotTestJSON-714369247-project Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 146c869a-86bf-48a4-9779-8fdf2f919a56 could not be found. Jun 21 08:24:09.880109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '146c869a-86bf-48a4-9779-8fdf2f919a56'} Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146c869a-86bf-48a4-9779-8fdf2f919a56 could not be found. Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:24:09.881223 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146c869a-86bf-48a4-9779-8fdf2f919a56 could not be found. Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146c869a-86bf-48a4-9779-8fdf2f919a56 could not be found. Jun 21 08:24:09.883487 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:24:09.885718 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-cb777665-65d9-4d69-a45d-c5e4ff733282 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Returning 404 to user: Instance 146c869a-86bf-48a4-9779-8fdf2f919a56 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:24:09.885718 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-cb777665-65d9-4d69-a45d-c5e4ff733282 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56" status: 404 len: 111 microversion: 2.1 time: 0.030589 Jun 21 08:24:09.885718 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 518/970] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:09 2022] GET /compute/v2.1/servers/146c869a-86bf-48a4-9779-8fdf2f919a56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:24:17.687028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1089125311", "imageRef": "7f203ed8-0e3c-4ebf-929f-c7a25527da65", "flavorRef": "452", "networks": [{"uuid": "5173ea1b-6939-4f27-ba30-a33c0a2db708"}]}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:24:17.694822 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:17.739506 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.network.neutron [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] validate_networks() for [('5173ea1b-6939-4f27-ba30-a33c0a2db708', None, None, None, None, None)] {{(pid=117548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:24:18.108195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Flavor limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:24:18.108614 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Image limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:24:18.109081 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Flavor pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:24:18.109484 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Image pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:24:18.109920 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:24:18.120888 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:18.121196 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:18.122103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:18.122540 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:18.141315 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Getting quotas for project e2c14f0f94af45b7b3117234993b591e. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:24:18.145131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Getting quotas for user 2f7b0c3b933d4bb5adb01bec696eed0b and project e2c14f0f94af45b7b3117234993b591e. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:24:18.155592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Going to run 1 instances... {{(pid=117548) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:24:18.157826 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f203ed8-0e3c-4ebf-929f-c7a25527da65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:24:18.204594 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3141cd93-191b-4a32-9698-7d590f174310 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521442 Jun 21 08:24:18.205285 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 453/971] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:24:18.218776 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-aa18280c-2bdc-45cd-a248-ef450889465a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:18.219704 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-aa18280c-2bdc-45cd-a248-ef450889465a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:18.293683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-aa18280c-2bdc-45cd-a248-ef450889465a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:18.303615 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-aa18280c-2bdc-45cd-a248-ef450889465a tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1219 microversion: 2.1 time: 0.091173 Jun 21 08:24:18.305038 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 519/972] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:18 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:19.322224 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-14ad3ac5-85f5-4f95-89a2-597b038ccc23 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:19.322878 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-14ad3ac5-85f5-4f95-89a2-597b038ccc23 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:19.329471 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-14ad3ac5-85f5-4f95-89a2-597b038ccc23 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:19.329917 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-14ad3ac5-85f5-4f95-89a2-597b038ccc23 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:19.330712 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-14ad3ac5-85f5-4f95-89a2-597b038ccc23 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:19.331147 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-14ad3ac5-85f5-4f95-89a2-597b038ccc23 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:19.434995 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-14ad3ac5-85f5-4f95-89a2-597b038ccc23 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:19.442600 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-14ad3ac5-85f5-4f95-89a2-597b038ccc23 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1277 microversion: 2.1 time: 0.124842 Jun 21 08:24:19.443213 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 454/973] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:19 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:20.462089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-81bcddde-8407-4a5b-9844-65170b0f25b6 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:20.463631 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-81bcddde-8407-4a5b-9844-65170b0f25b6 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:20.467976 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:20.482021 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-0176fead-2f74-4027-a9a2-89c432aed89d req-07e49de1-c108-4294-ab59-cd7db381270e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe2faa3-c3b6-4597-aad5-28607cf64979", "tag": "50b8e08d-d2b2-4767-9ad6-c676bfcb9cef"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:24:20.490684 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81bcddde-8407-4a5b-9844-65170b0f25b6 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:20.491097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81bcddde-8407-4a5b-9844-65170b0f25b6 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:20.491933 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81bcddde-8407-4a5b-9844-65170b0f25b6 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:20.492357 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-81bcddde-8407-4a5b-9844-65170b0f25b6 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:20.499390 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-0176fead-2f74-4027-a9a2-89c432aed89d req-07e49de1-c108-4294-ab59-cd7db381270e service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:20.499853 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-0176fead-2f74-4027-a9a2-89c432aed89d req-07e49de1-c108-4294-ab59-cd7db381270e service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:20.514766 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-0176fead-2f74-4027-a9a2-89c432aed89d req-07e49de1-c108-4294-ab59-cd7db381270e service nova] Creating event network-changed:50b8e08d-d2b2-4767-9ad6-c676bfcb9cef for instance 0fe2faa3-c3b6-4597-aad5-28607cf64979 on hv-cinder-83697 Jun 21 08:24:20.529915 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-0176fead-2f74-4027-a9a2-89c432aed89d req-07e49de1-c108-4294-ab59-cd7db381270e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051502 Jun 21 08:24:20.532400 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 455/974] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:24:20.654880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-81bcddde-8407-4a5b-9844-65170b0f25b6 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:20.663390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-81bcddde-8407-4a5b-9844-65170b0f25b6 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1319 microversion: 2.1 time: 0.205876 Jun 21 08:24:20.663390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 520/975] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:20 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:21.680731 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c63a8b8a-0a43-4f10-b7c8-f520feac257d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:21.681424 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c63a8b8a-0a43-4f10-b7c8-f520feac257d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:21.687568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c63a8b8a-0a43-4f10-b7c8-f520feac257d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:21.688012 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c63a8b8a-0a43-4f10-b7c8-f520feac257d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:21.688775 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c63a8b8a-0a43-4f10-b7c8-f520feac257d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:21.689194 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c63a8b8a-0a43-4f10-b7c8-f520feac257d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:21.899768 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c63a8b8a-0a43-4f10-b7c8-f520feac257d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:21.907315 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c63a8b8a-0a43-4f10-b7c8-f520feac257d tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1319 microversion: 2.1 time: 0.231222 Jun 21 08:24:21.907883 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 456/976] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:21 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:22.924868 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5e09b0d8-74c7-45ff-8c81-b57d0fd4af2e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:22.925439 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5e09b0d8-74c7-45ff-8c81-b57d0fd4af2e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:22.927741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=28 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:22.933898 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5e09b0d8-74c7-45ff-8c81-b57d0fd4af2e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:22.934504 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5e09b0d8-74c7-45ff-8c81-b57d0fd4af2e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:22.935437 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5e09b0d8-74c7-45ff-8c81-b57d0fd4af2e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:22.935873 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5e09b0d8-74c7-45ff-8c81-b57d0fd4af2e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:23.086378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-5e09b0d8-74c7-45ff-8c81-b57d0fd4af2e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:23.094061 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5e09b0d8-74c7-45ff-8c81-b57d0fd4af2e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1319 microversion: 2.1 time: 0.173046 Jun 21 08:24:23.094647 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 521/977] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:22 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:24.111853 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-799c0db3-9378-4cb5-a24c-781bd557140e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:24.112460 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-799c0db3-9378-4cb5-a24c-781bd557140e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:24.118967 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-799c0db3-9378-4cb5-a24c-781bd557140e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:24.119413 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-799c0db3-9378-4cb5-a24c-781bd557140e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:24.120165 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-799c0db3-9378-4cb5-a24c-781bd557140e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:24.120623 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-799c0db3-9378-4cb5-a24c-781bd557140e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:24.253690 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-799c0db3-9378-4cb5-a24c-781bd557140e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:24.262099 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-799c0db3-9378-4cb5-a24c-781bd557140e tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1319 microversion: 2.1 time: 0.154164 Jun 21 08:24:24.262646 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 457/978] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:24 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:24:24.390712 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-2597aecf-0b11-460e-92b5-e7db1d72b838 req-0cfe782e-d2c4-48c3-87bc-279ab2c601bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe2faa3-c3b6-4597-aad5-28607cf64979", "name": "network-vif-plugged", "status": "completed", "tag": "50b8e08d-d2b2-4767-9ad6-c676bfcb9cef"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:24:24.399513 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-2597aecf-0b11-460e-92b5-e7db1d72b838 req-0cfe782e-d2c4-48c3-87bc-279ab2c601bf service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:24.399984 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-2597aecf-0b11-460e-92b5-e7db1d72b838 req-0cfe782e-d2c4-48c3-87bc-279ab2c601bf service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:24.415250 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-2597aecf-0b11-460e-92b5-e7db1d72b838 req-0cfe782e-d2c4-48c3-87bc-279ab2c601bf service nova] Creating event network-vif-plugged:50b8e08d-d2b2-4767-9ad6-c676bfcb9cef for instance 0fe2faa3-c3b6-4597-aad5-28607cf64979 on hv-cinder-83697 Jun 21 08:24:24.420656 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-2597aecf-0b11-460e-92b5-e7db1d72b838 req-0cfe782e-d2c4-48c3-87bc-279ab2c601bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033630 Jun 21 08:24:24.421266 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 522/979] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:24:25.279880 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-541f05f3-8e93-4e7e-aca4-6f70ad7786d7 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:25.280494 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-541f05f3-8e93-4e7e-aca4-6f70ad7786d7 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:25.286938 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-541f05f3-8e93-4e7e-aca4-6f70ad7786d7 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:25.287380 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-541f05f3-8e93-4e7e-aca4-6f70ad7786d7 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:25.288136 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-541f05f3-8e93-4e7e-aca4-6f70ad7786d7 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:25.288802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-541f05f3-8e93-4e7e-aca4-6f70ad7786d7 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:25.422989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-541f05f3-8e93-4e7e-aca4-6f70ad7786d7 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:25.431247 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-541f05f3-8e93-4e7e-aca4-6f70ad7786d7 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1319 microversion: 2.1 time: 0.155298 Jun 21 08:24:25.431821 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 458/980] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:25 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:24:26.448940 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-58f98aab-5091-49dd-bd92-36487a0e040c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:26.449649 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-58f98aab-5091-49dd-bd92-36487a0e040c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:26.456303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-58f98aab-5091-49dd-bd92-36487a0e040c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:26.456748 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-58f98aab-5091-49dd-bd92-36487a0e040c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:26.457503 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-58f98aab-5091-49dd-bd92-36487a0e040c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:26.457937 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-58f98aab-5091-49dd-bd92-36487a0e040c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:26.588566 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-58f98aab-5091-49dd-bd92-36487a0e040c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:26.596093 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-58f98aab-5091-49dd-bd92-36487a0e040c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1508 microversion: 2.1 time: 0.151806 Jun 21 08:24:26.596684 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 523/981] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:26 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:26.613290 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8aeda5d6-ca80-4e27-8429-9156ab38351c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1f79a0f-90ae-446c-9c90-ede81270150d", "device": "/dev/sdb"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:24:26.614401 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8aeda5d6-ca80-4e27-8429-9156ab38351c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:26.621479 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8aeda5d6-ca80-4e27-8429-9156ab38351c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:26.621934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8aeda5d6-ca80-4e27-8429-9156ab38351c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:26.622733 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8aeda5d6-ca80-4e27-8429-9156ab38351c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:26.623175 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8aeda5d6-ca80-4e27-8429-9156ab38351c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:26.867855 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8aeda5d6-ca80-4e27-8429-9156ab38351c tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "POST /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258360 Jun 21 08:24:26.868551 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 459/982] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 08:24:26 2022] POST /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:24:40.810742 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6aac6620-3162-440a-9f12-2d06fcd9ac3c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:40.814062 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6aac6620-3162-440a-9f12-2d06fcd9ac3c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:40.814062 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:40.814387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=5 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:40.815105 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=20 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:40.821968 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6aac6620-3162-440a-9f12-2d06fcd9ac3c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:40.822430 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6aac6620-3162-440a-9f12-2d06fcd9ac3c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:40.823333 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6aac6620-3162-440a-9f12-2d06fcd9ac3c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:40.823716 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6aac6620-3162-440a-9f12-2d06fcd9ac3c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:40.850138 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6aac6620-3162-440a-9f12-2d06fcd9ac3c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/ips" status: 200 len: 151 microversion: 2.20 time: 0.043540 Jun 21 08:24:40.851371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 524/983] 10.222.0.36 () {60 vars in 1288 bytes} [Tue Jun 21 08:24:40 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 08:24:43.220494 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:43.221706 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=6 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:43.222581 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:43.224301 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:43.230649 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a60c9a02-3587-44f2-9cea-c5ccadd2dc49 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:24:43.231614 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a60c9a02-3587-44f2-9cea-c5ccadd2dc49 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:43.243558 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a60c9a02-3587-44f2-9cea-c5ccadd2dc49 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:43.244027 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a60c9a02-3587-44f2-9cea-c5ccadd2dc49 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:43.244818 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a60c9a02-3587-44f2-9cea-c5ccadd2dc49 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:43.245256 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a60c9a02-3587-44f2-9cea-c5ccadd2dc49 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:43.276767 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-a60c9a02-3587-44f2-9cea-c5ccadd2dc49 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lazy-loading 'flavor' on Instance uuid b5fda813-f341-4923-a4f9-5025f6790375 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:24:43.550896 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a60c9a02-3587-44f2-9cea-c5ccadd2dc49 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "POST /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/action" status: 202 len: 0 microversion: 2.20 time: 0.331659 Jun 21 08:24:43.553980 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 460/984] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 21 08:24:43 2022] POST /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:24:43.561094 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-dd16d2f0-de40-45e6-9117-4f35c4b7b9ac tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:43.561914 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-dd16d2f0-de40-45e6-9117-4f35c4b7b9ac tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:43.568683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd16d2f0-de40-45e6-9117-4f35c4b7b9ac tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:43.569639 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd16d2f0-de40-45e6-9117-4f35c4b7b9ac tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:43.570498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd16d2f0-de40-45e6-9117-4f35c4b7b9ac tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:43.570966 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-dd16d2f0-de40-45e6-9117-4f35c4b7b9ac tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:43.721249 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-dd16d2f0-de40-45e6-9117-4f35c4b7b9ac tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:43.730656 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-dd16d2f0-de40-45e6-9117-4f35c4b7b9ac tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:43.731698 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-dd16d2f0-de40-45e6-9117-4f35c4b7b9ac tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:43.732946 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-dd16d2f0-de40-45e6-9117-4f35c4b7b9ac tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.175804 Jun 21 08:24:43.733451 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 525/985] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:43 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:44.296355 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d252193a-22c4-4aaf-840f-b74f611bde1b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:44.297297 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d252193a-22c4-4aaf-840f-b74f611bde1b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:44.303563 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d252193a-22c4-4aaf-840f-b74f611bde1b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:44.304061 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d252193a-22c4-4aaf-840f-b74f611bde1b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:44.305026 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d252193a-22c4-4aaf-840f-b74f611bde1b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:44.305457 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d252193a-22c4-4aaf-840f-b74f611bde1b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:44.391109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.objects.instance [None req-d252193a-22c4-4aaf-840f-b74f611bde1b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lazy-loading 'services' on Instance uuid 0fe2faa3-c3b6-4597-aad5-28607cf64979 {{(pid=117548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:24:44.471859 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d252193a-22c4-4aaf-840f-b74f611bde1b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979/os-volume_attachments/d1f79a0f-90ae-446c-9c90-ede81270150d" status: 202 len: 0 microversion: 2.1 time: 0.180843 Jun 21 08:24:44.472745 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 461/986] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 08:24:44 2022] DELETE /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979/os-volume_attachments/d1f79a0f-90ae-446c-9c90-ede81270150d => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:24:44.752023 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-da7bd081-b647-4a53-9f41-7cc6448eb57f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:44.752830 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-da7bd081-b647-4a53-9f41-7cc6448eb57f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:44.760649 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-da7bd081-b647-4a53-9f41-7cc6448eb57f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:44.761104 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-da7bd081-b647-4a53-9f41-7cc6448eb57f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:44.761905 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-da7bd081-b647-4a53-9f41-7cc6448eb57f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:44.762349 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-da7bd081-b647-4a53-9f41-7cc6448eb57f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:44.927491 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-da7bd081-b647-4a53-9f41-7cc6448eb57f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:44.939085 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-da7bd081-b647-4a53-9f41-7cc6448eb57f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:44.940990 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-da7bd081-b647-4a53-9f41-7cc6448eb57f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:44.942202 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-da7bd081-b647-4a53-9f41-7cc6448eb57f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.194226 Jun 21 08:24:44.943518 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 526/987] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:44 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:45.608156 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3a8d3147-73c1-4e3d-b807-13422dfac74b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:45.608729 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3a8d3147-73c1-4e3d-b807-13422dfac74b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:45.615690 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3a8d3147-73c1-4e3d-b807-13422dfac74b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:45.616143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3a8d3147-73c1-4e3d-b807-13422dfac74b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:45.616915 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3a8d3147-73c1-4e3d-b807-13422dfac74b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:45.617378 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3a8d3147-73c1-4e3d-b807-13422dfac74b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:45.647023 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3a8d3147-73c1-4e3d-b807-13422dfac74b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:24:45.725057 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3a8d3147-73c1-4e3d-b807-13422dfac74b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 204 len: 0 microversion: 2.1 time: 0.121130 Jun 21 08:24:45.725898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 462/988] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:24:45 2022] DELETE /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:24:45.737906 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-95040245-2286-4cbf-819e-4c9427271a0b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:45.739371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-95040245-2286-4cbf-819e-4c9427271a0b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:45.750288 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-95040245-2286-4cbf-819e-4c9427271a0b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:45.751003 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-95040245-2286-4cbf-819e-4c9427271a0b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:45.752730 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-95040245-2286-4cbf-819e-4c9427271a0b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:45.754445 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-95040245-2286-4cbf-819e-4c9427271a0b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:45.904001 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-95040245-2286-4cbf-819e-4c9427271a0b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:45.912231 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-95040245-2286-4cbf-819e-4c9427271a0b tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1514 microversion: 2.1 time: 0.180932 Jun 21 08:24:45.915682 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 527/989] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:45 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:45.963592 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-903354f5-2008-4334-8ff5-df9334f48b2a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:45.964296 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-903354f5-2008-4334-8ff5-df9334f48b2a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:45.970438 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-903354f5-2008-4334-8ff5-df9334f48b2a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:45.970918 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-903354f5-2008-4334-8ff5-df9334f48b2a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:45.971686 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-903354f5-2008-4334-8ff5-df9334f48b2a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:45.972121 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-903354f5-2008-4334-8ff5-df9334f48b2a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:46.122531 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-903354f5-2008-4334-8ff5-df9334f48b2a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:46.132357 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-903354f5-2008-4334-8ff5-df9334f48b2a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:46.134446 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-903354f5-2008-4334-8ff5-df9334f48b2a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:46.135318 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-903354f5-2008-4334-8ff5-df9334f48b2a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.177388 Jun 21 08:24:46.135883 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 463/990] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:45 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:46.929755 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-194f4f42-4d1a-4b13-b825-278e143566ae tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:46.931228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-194f4f42-4d1a-4b13-b825-278e143566ae tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:46.937820 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-194f4f42-4d1a-4b13-b825-278e143566ae tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:46.938266 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-194f4f42-4d1a-4b13-b825-278e143566ae tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:46.939065 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-194f4f42-4d1a-4b13-b825-278e143566ae tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:46.939531 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-194f4f42-4d1a-4b13-b825-278e143566ae tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:47.089580 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-194f4f42-4d1a-4b13-b825-278e143566ae tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:47.098748 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-194f4f42-4d1a-4b13-b825-278e143566ae tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1514 microversion: 2.1 time: 0.172873 Jun 21 08:24:47.099314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 528/991] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:46 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:47.153594 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-438b76d4-7227-4a19-93cb-8e2a9a9007b3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:47.154209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-438b76d4-7227-4a19-93cb-8e2a9a9007b3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:47.160828 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-438b76d4-7227-4a19-93cb-8e2a9a9007b3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:47.161271 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-438b76d4-7227-4a19-93cb-8e2a9a9007b3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:47.162038 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-438b76d4-7227-4a19-93cb-8e2a9a9007b3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:47.162465 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-438b76d4-7227-4a19-93cb-8e2a9a9007b3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:47.295289 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-438b76d4-7227-4a19-93cb-8e2a9a9007b3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:47.304735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-438b76d4-7227-4a19-93cb-8e2a9a9007b3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:47.307646 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-438b76d4-7227-4a19-93cb-8e2a9a9007b3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:47.308933 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-438b76d4-7227-4a19-93cb-8e2a9a9007b3 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.159348 Jun 21 08:24:47.309739 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 464/992] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:47 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:48.116933 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-c411609e-4c04-4eae-bd70-43fc1b852904 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:48.118022 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-c411609e-4c04-4eae-bd70-43fc1b852904 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:48.125005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c411609e-4c04-4eae-bd70-43fc1b852904 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:48.125545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c411609e-4c04-4eae-bd70-43fc1b852904 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:48.126399 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c411609e-4c04-4eae-bd70-43fc1b852904 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:48.126940 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-c411609e-4c04-4eae-bd70-43fc1b852904 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:48.166551 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-a56209e5-b89f-47da-8af9-1ad842b1a06b req-52ea46f8-11a4-4b69-b98f-30135d8d0452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe2faa3-c3b6-4597-aad5-28607cf64979", "name": "network-vif-deleted", "tag": "50b8e08d-d2b2-4767-9ad6-c676bfcb9cef"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:24:48.177810 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-a56209e5-b89f-47da-8af9-1ad842b1a06b req-52ea46f8-11a4-4b69-b98f-30135d8d0452 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:48.178265 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-a56209e5-b89f-47da-8af9-1ad842b1a06b req-52ea46f8-11a4-4b69-b98f-30135d8d0452 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:48.205374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-a56209e5-b89f-47da-8af9-1ad842b1a06b req-52ea46f8-11a4-4b69-b98f-30135d8d0452 service nova] Creating event network-vif-deleted:50b8e08d-d2b2-4767-9ad6-c676bfcb9cef for instance 0fe2faa3-c3b6-4597-aad5-28607cf64979 on hv-cinder-83697 Jun 21 08:24:48.213819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-c411609e-4c04-4eae-bd70-43fc1b852904 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7b0c3b933d4bb5adb01bec696eed0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c14f0f94af45b7b3117234993b591e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:48.214913 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-a56209e5-b89f-47da-8af9-1ad842b1a06b req-52ea46f8-11a4-4b69-b98f-30135d8d0452 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052523 Jun 21 08:24:48.216252 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 465/993] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:24:48.222404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-c411609e-4c04-4eae-bd70-43fc1b852904 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 200 len: 1472 microversion: 2.1 time: 0.109393 Jun 21 08:24:48.223443 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 529/994] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:48 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 1472 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:24:48.330752 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f8ca329f-64e4-4b82-99d6-a80fc80dbd9c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:48.331490 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f8ca329f-64e4-4b82-99d6-a80fc80dbd9c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:48.337924 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f8ca329f-64e4-4b82-99d6-a80fc80dbd9c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:48.338380 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f8ca329f-64e4-4b82-99d6-a80fc80dbd9c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:48.339310 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f8ca329f-64e4-4b82-99d6-a80fc80dbd9c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:48.339760 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f8ca329f-64e4-4b82-99d6-a80fc80dbd9c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:48.482990 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f8ca329f-64e4-4b82-99d6-a80fc80dbd9c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:48.491042 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f8ca329f-64e4-4b82-99d6-a80fc80dbd9c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:48.493173 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f8ca329f-64e4-4b82-99d6-a80fc80dbd9c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:48.494390 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f8ca329f-64e4-4b82-99d6-a80fc80dbd9c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.169492 Jun 21 08:24:48.494982 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 466/995] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:48 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:49.248011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5171da7d-d11c-4038-b27e-c2d58b9efe74 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:49.248616 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-5171da7d-d11c-4038-b27e-c2d58b9efe74 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] [instance: 0fe2faa3-c3b6-4597-aad5-28607cf64979] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:49.255361 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5171da7d-d11c-4038-b27e-c2d58b9efe74 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:49.255803 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5171da7d-d11c-4038-b27e-c2d58b9efe74 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:49.256553 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5171da7d-d11c-4038-b27e-c2d58b9efe74 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:49.256983 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-5171da7d-d11c-4038-b27e-c2d58b9efe74 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:49.429694 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-5171da7d-d11c-4038-b27e-c2d58b9efe74 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] HTTP exception thrown: Instance 0fe2faa3-c3b6-4597-aad5-28607cf64979 could not be found. Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5171da7d-d11c-4038-b27e-c2d58b9efe74 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Request method failure captured: Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 HTTP/1.1 Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX_12rgTJ8sUfdrWwMj16o-t45JIcWr_e_Oes6r1Z2SaOGsmmetXl9jtxyH46C4VCZIYlW58CNgC7wtZRqcsfQ91kfxzWu1EEB_ev6nDEId02bExUFeh19pc2dbvq9UKJpAOIl-wbafsO0e5QClXOIflGcDqw6-EgUc5VQ38YUh3X4Q Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: e2c14f0f94af45b7b3117234993b591e Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-VolumesSnapshotTestJSON-714369247 Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:24:49.431512 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2c14f0f94af45b7b3117234993b591e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e2c14f0f94af45b7b3117234993b591e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2c14f0f94af45b7b3117234993b591e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e2c14f0f94af45b7b3117234993b591e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-VolumesSnapshotTestJSON-714369247 Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: e2c14f0f94af45b7b3117234993b591e Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-714369247 Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-VolumesSnapshotTestJSON-714369247-project Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 2f7b0c3b933d4bb5adb01bec696eed0b Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-VolumesSnapshotTestJSON-714369247-project Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 0fe2faa3-c3b6-4597-aad5-28607cf64979 could not be found. Jun 21 08:24:49.433342 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '0fe2faa3-c3b6-4597-aad5-28607cf64979'} Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fe2faa3-c3b6-4597-aad5-28607cf64979 could not be found. Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:24:49.434417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fe2faa3-c3b6-4597-aad5-28607cf64979 could not be found. Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fe2faa3-c3b6-4597-aad5-28607cf64979 could not be found. Jun 21 08:24:49.436057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:24:49.437641 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-5171da7d-d11c-4038-b27e-c2d58b9efe74 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] Returning 404 to user: Instance 0fe2faa3-c3b6-4597-aad5-28607cf64979 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:24:49.437641 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-5171da7d-d11c-4038-b27e-c2d58b9efe74 tempest-VolumesSnapshotTestJSON-714369247 tempest-VolumesSnapshotTestJSON-714369247-project] 10.222.0.36 "GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979" status: 404 len: 111 microversion: 2.1 time: 0.188757 Jun 21 08:24:49.437641 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 530/996] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:24:49 2022] GET /compute/v2.1/servers/0fe2faa3-c3b6-4597-aad5-28607cf64979 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:24:49.514012 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-21d04bb5-c468-431b-a0e1-0dfd0e475beb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:49.514719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-21d04bb5-c468-431b-a0e1-0dfd0e475beb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:49.521473 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-21d04bb5-c468-431b-a0e1-0dfd0e475beb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:49.522165 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-21d04bb5-c468-431b-a0e1-0dfd0e475beb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:49.522978 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-21d04bb5-c468-431b-a0e1-0dfd0e475beb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:49.523419 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-21d04bb5-c468-431b-a0e1-0dfd0e475beb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:49.699460 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-21d04bb5-c468-431b-a0e1-0dfd0e475beb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:49.705793 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-21d04bb5-c468-431b-a0e1-0dfd0e475beb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:49.707691 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-21d04bb5-c468-431b-a0e1-0dfd0e475beb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:49.709571 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-21d04bb5-c468-431b-a0e1-0dfd0e475beb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.199099 Jun 21 08:24:49.710303 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 467/997] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:49 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:50.728868 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a457c197-1130-4521-b0b2-6ad2ba6ecb4e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:50.729526 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a457c197-1130-4521-b0b2-6ad2ba6ecb4e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:50.736878 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a457c197-1130-4521-b0b2-6ad2ba6ecb4e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:50.737327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a457c197-1130-4521-b0b2-6ad2ba6ecb4e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:50.738114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a457c197-1130-4521-b0b2-6ad2ba6ecb4e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:50.738562 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a457c197-1130-4521-b0b2-6ad2ba6ecb4e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:50.882597 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a457c197-1130-4521-b0b2-6ad2ba6ecb4e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:50.891144 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a457c197-1130-4521-b0b2-6ad2ba6ecb4e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:50.892643 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a457c197-1130-4521-b0b2-6ad2ba6ecb4e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:50.893793 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a457c197-1130-4521-b0b2-6ad2ba6ecb4e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.169104 Jun 21 08:24:50.894518 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 531/998] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:50 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:51.914129 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-fd05cc09-dc9f-405a-9383-7d2a6b538893 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:51.914996 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-fd05cc09-dc9f-405a-9383-7d2a6b538893 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:51.921495 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fd05cc09-dc9f-405a-9383-7d2a6b538893 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:51.922183 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fd05cc09-dc9f-405a-9383-7d2a6b538893 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:51.922722 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fd05cc09-dc9f-405a-9383-7d2a6b538893 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:51.923174 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-fd05cc09-dc9f-405a-9383-7d2a6b538893 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:52.069804 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fd05cc09-dc9f-405a-9383-7d2a6b538893 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:52.079160 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fd05cc09-dc9f-405a-9383-7d2a6b538893 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:52.080665 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-fd05cc09-dc9f-405a-9383-7d2a6b538893 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:52.081835 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-fd05cc09-dc9f-405a-9383-7d2a6b538893 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.172217 Jun 21 08:24:52.082396 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 468/999] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:51 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:53.104658 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-31799180-268a-4e57-bbc8-7c3245748776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:53.105531 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-31799180-268a-4e57-bbc8-7c3245748776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:53.115092 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31799180-268a-4e57-bbc8-7c3245748776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:53.115723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31799180-268a-4e57-bbc8-7c3245748776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:53.116911 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31799180-268a-4e57-bbc8-7c3245748776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:53.118229 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-31799180-268a-4e57-bbc8-7c3245748776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:53.295080 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-31799180-268a-4e57-bbc8-7c3245748776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:53.309880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-31799180-268a-4e57-bbc8-7c3245748776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:53.312646 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-31799180-268a-4e57-bbc8-7c3245748776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:53.314325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-31799180-268a-4e57-bbc8-7c3245748776 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.215861 Jun 21 08:24:53.315337 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 532/1000] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:53 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:54.336988 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-437aa0ca-ff19-4551-b4ed-4942273acd11 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:54.337808 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-437aa0ca-ff19-4551-b4ed-4942273acd11 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:54.346364 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-437aa0ca-ff19-4551-b4ed-4942273acd11 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:54.346987 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-437aa0ca-ff19-4551-b4ed-4942273acd11 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:54.348634 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-437aa0ca-ff19-4551-b4ed-4942273acd11 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:54.348976 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-437aa0ca-ff19-4551-b4ed-4942273acd11 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:54.528134 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-437aa0ca-ff19-4551-b4ed-4942273acd11 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:54.536830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-437aa0ca-ff19-4551-b4ed-4942273acd11 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:54.538362 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-437aa0ca-ff19-4551-b4ed-4942273acd11 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:54.539727 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-437aa0ca-ff19-4551-b4ed-4942273acd11 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.207510 Jun 21 08:24:54.540364 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 469/1001] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:54 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:24:55.564782 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6023df9d-4932-44ea-a7e7-701a51e5b264 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:55.565404 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6023df9d-4932-44ea-a7e7-701a51e5b264 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:55.573531 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6023df9d-4932-44ea-a7e7-701a51e5b264 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:55.574127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6023df9d-4932-44ea-a7e7-701a51e5b264 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:55.575586 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6023df9d-4932-44ea-a7e7-701a51e5b264 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:55.576314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6023df9d-4932-44ea-a7e7-701a51e5b264 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:55.739666 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-6023df9d-4932-44ea-a7e7-701a51e5b264 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:55.752085 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-6023df9d-4932-44ea-a7e7-701a51e5b264 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:55.753740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-6023df9d-4932-44ea-a7e7-701a51e5b264 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:55.755195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6023df9d-4932-44ea-a7e7-701a51e5b264 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.194261 Jun 21 08:24:55.755862 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 533/1002] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:55 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:56.777858 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4815f8db-8111-4bc3-b639-aea495f38f0b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:56.779064 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4815f8db-8111-4bc3-b639-aea495f38f0b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:56.787889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4815f8db-8111-4bc3-b639-aea495f38f0b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:56.788421 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4815f8db-8111-4bc3-b639-aea495f38f0b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:56.790958 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4815f8db-8111-4bc3-b639-aea495f38f0b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:56.790958 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4815f8db-8111-4bc3-b639-aea495f38f0b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:56.936242 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4815f8db-8111-4bc3-b639-aea495f38f0b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:56.945162 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4815f8db-8111-4bc3-b639-aea495f38f0b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:56.946904 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4815f8db-8111-4bc3-b639-aea495f38f0b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:56.948221 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4815f8db-8111-4bc3-b639-aea495f38f0b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.176917 Jun 21 08:24:56.948837 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 470/1003] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:56 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:24:57.970721 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-497bd8d2-988e-46cc-8cca-5b6ebbfda370 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:57.971385 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-497bd8d2-988e-46cc-8cca-5b6ebbfda370 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:57.981036 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-497bd8d2-988e-46cc-8cca-5b6ebbfda370 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:57.981447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-497bd8d2-988e-46cc-8cca-5b6ebbfda370 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:57.982221 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-497bd8d2-988e-46cc-8cca-5b6ebbfda370 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:57.982677 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-497bd8d2-988e-46cc-8cca-5b6ebbfda370 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:58.152549 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-497bd8d2-988e-46cc-8cca-5b6ebbfda370 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:58.164922 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-497bd8d2-988e-46cc-8cca-5b6ebbfda370 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:58.167424 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-497bd8d2-988e-46cc-8cca-5b6ebbfda370 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:58.169232 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-497bd8d2-988e-46cc-8cca-5b6ebbfda370 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.204240 Jun 21 08:24:58.170013 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 534/1004] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:57 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:24:59.190734 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7ac95755-7245-46e0-8bd5-eebbf9aa95db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:24:59.191331 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-7ac95755-7245-46e0-8bd5-eebbf9aa95db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:24:59.197896 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7ac95755-7245-46e0-8bd5-eebbf9aa95db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:59.198336 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7ac95755-7245-46e0-8bd5-eebbf9aa95db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:59.199128 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7ac95755-7245-46e0-8bd5-eebbf9aa95db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:24:59.199556 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-7ac95755-7245-46e0-8bd5-eebbf9aa95db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:24:59.345112 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-7ac95755-7245-46e0-8bd5-eebbf9aa95db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:59.354389 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-7ac95755-7245-46e0-8bd5-eebbf9aa95db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:59.355972 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-7ac95755-7245-46e0-8bd5-eebbf9aa95db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:24:59.357161 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7ac95755-7245-46e0-8bd5-eebbf9aa95db tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.170710 Jun 21 08:24:59.357722 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 471/1005] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:24:59 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:00.381273 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d073b1a1-a94c-476f-ae31-794a7aa2765d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:00.391345 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d073b1a1-a94c-476f-ae31-794a7aa2765d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:00.407972 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d073b1a1-a94c-476f-ae31-794a7aa2765d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:00.408617 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d073b1a1-a94c-476f-ae31-794a7aa2765d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:00.409927 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d073b1a1-a94c-476f-ae31-794a7aa2765d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:00.410850 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d073b1a1-a94c-476f-ae31-794a7aa2765d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:00.569700 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d073b1a1-a94c-476f-ae31-794a7aa2765d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:00.582507 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d073b1a1-a94c-476f-ae31-794a7aa2765d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:00.584353 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d073b1a1-a94c-476f-ae31-794a7aa2765d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:00.585670 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d073b1a1-a94c-476f-ae31-794a7aa2765d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.212447 Jun 21 08:25:00.586115 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 535/1006] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:00 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:01.605115 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-61c370c6-ac25-401f-9861-0fd8682e6bb7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:01.605736 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-61c370c6-ac25-401f-9861-0fd8682e6bb7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:01.612419 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-61c370c6-ac25-401f-9861-0fd8682e6bb7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:01.612884 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-61c370c6-ac25-401f-9861-0fd8682e6bb7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:01.613649 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-61c370c6-ac25-401f-9861-0fd8682e6bb7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:01.614217 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-61c370c6-ac25-401f-9861-0fd8682e6bb7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:01.777204 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-61c370c6-ac25-401f-9861-0fd8682e6bb7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:01.781429 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:01.789557 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-61c370c6-ac25-401f-9861-0fd8682e6bb7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:01.791802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-61c370c6-ac25-401f-9861-0fd8682e6bb7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:01.793201 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-61c370c6-ac25-401f-9861-0fd8682e6bb7 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.192763 Jun 21 08:25:01.793764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 472/1007] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:01 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:02.811944 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-76a3e3b5-cc31-4d62-8425-75fa55f6a12c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:02.812560 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-76a3e3b5-cc31-4d62-8425-75fa55f6a12c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:02.818892 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-76a3e3b5-cc31-4d62-8425-75fa55f6a12c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:02.819417 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-76a3e3b5-cc31-4d62-8425-75fa55f6a12c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:02.820141 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-76a3e3b5-cc31-4d62-8425-75fa55f6a12c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:02.820538 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-76a3e3b5-cc31-4d62-8425-75fa55f6a12c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:02.961135 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-76a3e3b5-cc31-4d62-8425-75fa55f6a12c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:02.971517 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-76a3e3b5-cc31-4d62-8425-75fa55f6a12c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:02.973454 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-76a3e3b5-cc31-4d62-8425-75fa55f6a12c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:02.974856 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-76a3e3b5-cc31-4d62-8425-75fa55f6a12c tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.166893 Jun 21 08:25:02.975991 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 536/1008] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:02 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:03.993692 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e208ed1a-f5d0-44e2-9457-db5d267641d0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:03.994862 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e208ed1a-f5d0-44e2-9457-db5d267641d0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:04.001976 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e208ed1a-f5d0-44e2-9457-db5d267641d0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:04.002542 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e208ed1a-f5d0-44e2-9457-db5d267641d0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:04.003367 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e208ed1a-f5d0-44e2-9457-db5d267641d0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:04.003806 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e208ed1a-f5d0-44e2-9457-db5d267641d0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:04.156227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e208ed1a-f5d0-44e2-9457-db5d267641d0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:04.164245 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e208ed1a-f5d0-44e2-9457-db5d267641d0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:04.165762 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e208ed1a-f5d0-44e2-9457-db5d267641d0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:04.167622 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e208ed1a-f5d0-44e2-9457-db5d267641d0 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.178139 Jun 21 08:25:04.168191 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 473/1009] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:03 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:25:05.186416 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-570cfcad-c6f7-432e-8451-8df5b11e6c32 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:05.187322 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-570cfcad-c6f7-432e-8451-8df5b11e6c32 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:05.194158 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-570cfcad-c6f7-432e-8451-8df5b11e6c32 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:05.194629 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-570cfcad-c6f7-432e-8451-8df5b11e6c32 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:05.195402 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-570cfcad-c6f7-432e-8451-8df5b11e6c32 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:05.195836 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-570cfcad-c6f7-432e-8451-8df5b11e6c32 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:05.340166 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-570cfcad-c6f7-432e-8451-8df5b11e6c32 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:05.348269 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-570cfcad-c6f7-432e-8451-8df5b11e6c32 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:05.349812 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-570cfcad-c6f7-432e-8451-8df5b11e6c32 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:05.351090 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-570cfcad-c6f7-432e-8451-8df5b11e6c32 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1745 microversion: 2.20 time: 0.169531 Jun 21 08:25:05.351731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 537/1010] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:05 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:06.373103 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-92b11416-05a8-4753-9bbb-0fb04ca79d9a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:06.373833 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-92b11416-05a8-4753-9bbb-0fb04ca79d9a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:06.396342 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-92b11416-05a8-4753-9bbb-0fb04ca79d9a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:06.404293 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-92b11416-05a8-4753-9bbb-0fb04ca79d9a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:06.405189 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-92b11416-05a8-4753-9bbb-0fb04ca79d9a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:06.405974 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-92b11416-05a8-4753-9bbb-0fb04ca79d9a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:06.567405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-92b11416-05a8-4753-9bbb-0fb04ca79d9a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:06.578816 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-92b11416-05a8-4753-9bbb-0fb04ca79d9a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:06.581378 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-92b11416-05a8-4753-9bbb-0fb04ca79d9a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:06.582781 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-ee450310-71d8-4a88-8ae2-0c104137e166 req-d4ef4559-10d4-478c-a188-3b88bb234ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fda813-f341-4923-a4f9-5025f6790375", "name": "network-vif-plugged", "status": "completed", "tag": "1d991028-ab62-4ec9-81b9-b98c925870ae"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:25:06.583539 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-92b11416-05a8-4753-9bbb-0fb04ca79d9a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1740 microversion: 2.20 time: 0.215024 Jun 21 08:25:06.584713 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 474/1011] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:06 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:06.600189 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-ee450310-71d8-4a88-8ae2-0c104137e166 req-d4ef4559-10d4-478c-a188-3b88bb234ef6 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:06.600659 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-ee450310-71d8-4a88-8ae2-0c104137e166 req-d4ef4559-10d4-478c-a188-3b88bb234ef6 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:06.626873 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-ee450310-71d8-4a88-8ae2-0c104137e166 req-d4ef4559-10d4-478c-a188-3b88bb234ef6 service nova] Creating event network-vif-plugged:1d991028-ab62-4ec9-81b9-b98c925870ae for instance b5fda813-f341-4923-a4f9-5025f6790375 on hv-cinder-83697 Jun 21 08:25:06.640929 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-ee450310-71d8-4a88-8ae2-0c104137e166 req-d4ef4559-10d4-478c-a188-3b88bb234ef6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063940 Jun 21 08:25:06.641846 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 538/1012] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:25:07.601973 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-94427757-a214-4b23-b814-8bbb6b1e004f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:07.602842 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-94427757-a214-4b23-b814-8bbb6b1e004f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:07.609575 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-94427757-a214-4b23-b814-8bbb6b1e004f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:07.610015 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-94427757-a214-4b23-b814-8bbb6b1e004f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:07.610813 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-94427757-a214-4b23-b814-8bbb6b1e004f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:07.611242 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-94427757-a214-4b23-b814-8bbb6b1e004f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:07.767650 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-94427757-a214-4b23-b814-8bbb6b1e004f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:07.777854 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-94427757-a214-4b23-b814-8bbb6b1e004f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:07.779406 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-94427757-a214-4b23-b814-8bbb6b1e004f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:07.780593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-94427757-a214-4b23-b814-8bbb6b1e004f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1740 microversion: 2.20 time: 0.182861 Jun 21 08:25:07.781317 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 475/1013] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:07 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:25:08.800767 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7b88899e-54bc-4eb7-a865-7254b91a980d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:08.802449 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7b88899e-54bc-4eb7-a865-7254b91a980d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:08.810993 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b88899e-54bc-4eb7-a865-7254b91a980d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:08.811443 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b88899e-54bc-4eb7-a865-7254b91a980d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:08.812574 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b88899e-54bc-4eb7-a865-7254b91a980d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:08.813326 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7b88899e-54bc-4eb7-a865-7254b91a980d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:08.982787 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7b88899e-54bc-4eb7-a865-7254b91a980d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:08.991083 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7b88899e-54bc-4eb7-a865-7254b91a980d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:08.992703 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-7b88899e-54bc-4eb7-a865-7254b91a980d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:08.993858 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7b88899e-54bc-4eb7-a865-7254b91a980d tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1740 microversion: 2.20 time: 0.197499 Jun 21 08:25:08.995124 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 539/1014] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:08 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:10.015397 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-09f523ba-14dc-4306-9b0a-e3351943b8ba tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:10.016714 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-09f523ba-14dc-4306-9b0a-e3351943b8ba tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:10.032118 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-09f523ba-14dc-4306-9b0a-e3351943b8ba tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:10.032641 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-09f523ba-14dc-4306-9b0a-e3351943b8ba tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:10.033492 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-09f523ba-14dc-4306-9b0a-e3351943b8ba tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:10.033992 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-09f523ba-14dc-4306-9b0a-e3351943b8ba tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:10.198877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-09f523ba-14dc-4306-9b0a-e3351943b8ba tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:10.207914 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-09f523ba-14dc-4306-9b0a-e3351943b8ba tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:10.209829 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-09f523ba-14dc-4306-9b0a-e3351943b8ba tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:10.211267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-09f523ba-14dc-4306-9b0a-e3351943b8ba tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1740 microversion: 2.20 time: 0.201777 Jun 21 08:25:10.212413 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 476/1015] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:10 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:11.231833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4ec93627-1969-4da8-8bf6-161c8dabe2d9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:11.233190 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4ec93627-1969-4da8-8bf6-161c8dabe2d9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:11.241818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=33 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:11.243877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4ec93627-1969-4da8-8bf6-161c8dabe2d9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:11.244672 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4ec93627-1969-4da8-8bf6-161c8dabe2d9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:11.245637 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4ec93627-1969-4da8-8bf6-161c8dabe2d9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:11.246071 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4ec93627-1969-4da8-8bf6-161c8dabe2d9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:11.270023 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=87 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:11.456873 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4ec93627-1969-4da8-8bf6-161c8dabe2d9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:11.469728 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4ec93627-1969-4da8-8bf6-161c8dabe2d9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:11.471722 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4ec93627-1969-4da8-8bf6-161c8dabe2d9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:11.473181 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4ec93627-1969-4da8-8bf6-161c8dabe2d9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1740 microversion: 2.20 time: 0.246138 Jun 21 08:25:11.473930 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 540/1016] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:11 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:12.493938 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f2683bc0-69a9-4a9e-bb0c-6a811bfcc93e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:12.496368 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f2683bc0-69a9-4a9e-bb0c-6a811bfcc93e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:12.505886 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f2683bc0-69a9-4a9e-bb0c-6a811bfcc93e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:12.507149 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f2683bc0-69a9-4a9e-bb0c-6a811bfcc93e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:12.508331 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f2683bc0-69a9-4a9e-bb0c-6a811bfcc93e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:12.509006 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f2683bc0-69a9-4a9e-bb0c-6a811bfcc93e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:12.688811 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f2683bc0-69a9-4a9e-bb0c-6a811bfcc93e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:12.698800 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f2683bc0-69a9-4a9e-bb0c-6a811bfcc93e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:12.700313 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f2683bc0-69a9-4a9e-bb0c-6a811bfcc93e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:12.701913 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f2683bc0-69a9-4a9e-bb0c-6a811bfcc93e tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1740 microversion: 2.20 time: 0.212904 Jun 21 08:25:12.703501 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 477/1017] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:12 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:13.721290 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-023aea77-e006-4f5a-a39d-83ed52470702 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:13.722831 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-023aea77-e006-4f5a-a39d-83ed52470702 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:13.729880 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-023aea77-e006-4f5a-a39d-83ed52470702 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:13.730325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-023aea77-e006-4f5a-a39d-83ed52470702 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:13.731248 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-023aea77-e006-4f5a-a39d-83ed52470702 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:13.731916 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-023aea77-e006-4f5a-a39d-83ed52470702 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:13.888278 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-023aea77-e006-4f5a-a39d-83ed52470702 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:13.896284 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-023aea77-e006-4f5a-a39d-83ed52470702 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:13.898075 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-023aea77-e006-4f5a-a39d-83ed52470702 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:13.899278 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-023aea77-e006-4f5a-a39d-83ed52470702 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1740 microversion: 2.20 time: 0.181883 Jun 21 08:25:13.900058 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 541/1018] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:13 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:14.920269 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-97d992e4-5c7a-4c66-ba9a-4fd1940dc6bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:14.920811 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-97d992e4-5c7a-4c66-ba9a-4fd1940dc6bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:14.923183 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:14.928892 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-97d992e4-5c7a-4c66-ba9a-4fd1940dc6bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:14.929350 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-97d992e4-5c7a-4c66-ba9a-4fd1940dc6bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:14.930227 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-97d992e4-5c7a-4c66-ba9a-4fd1940dc6bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:14.930680 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-97d992e4-5c7a-4c66-ba9a-4fd1940dc6bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:15.123792 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-97d992e4-5c7a-4c66-ba9a-4fd1940dc6bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:15.141625 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-97d992e4-5c7a-4c66-ba9a-4fd1940dc6bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:15.143876 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-97d992e4-5c7a-4c66-ba9a-4fd1940dc6bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:15.145127 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-97d992e4-5c7a-4c66-ba9a-4fd1940dc6bb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1740 microversion: 2.20 time: 0.230226 Jun 21 08:25:15.146461 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 478/1019] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:14 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:16.164387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f9e601d8-632a-4021-b450-620bc991756f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:16.165004 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f9e601d8-632a-4021-b450-620bc991756f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:16.171834 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f9e601d8-632a-4021-b450-620bc991756f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:16.172309 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f9e601d8-632a-4021-b450-620bc991756f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:16.173062 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f9e601d8-632a-4021-b450-620bc991756f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:16.173536 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f9e601d8-632a-4021-b450-620bc991756f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:16.309398 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f9e601d8-632a-4021-b450-620bc991756f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:16.317324 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f9e601d8-632a-4021-b450-620bc991756f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:16.318844 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f9e601d8-632a-4021-b450-620bc991756f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:16.319998 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f9e601d8-632a-4021-b450-620bc991756f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1722 microversion: 2.20 time: 0.159572 Jun 21 08:25:16.320551 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 542/1020] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:16 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:17.339578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a22c955d-983b-4680-b323-66d4512151da tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:17.340178 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a22c955d-983b-4680-b323-66d4512151da tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:17.346923 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a22c955d-983b-4680-b323-66d4512151da tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:17.347374 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a22c955d-983b-4680-b323-66d4512151da tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:17.348146 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a22c955d-983b-4680-b323-66d4512151da tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:17.348583 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a22c955d-983b-4680-b323-66d4512151da tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:17.740339 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a22c955d-983b-4680-b323-66d4512151da tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:17.748869 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a22c955d-983b-4680-b323-66d4512151da tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:17.750529 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a22c955d-983b-4680-b323-66d4512151da tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:17.751740 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a22c955d-983b-4680-b323-66d4512151da tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1722 microversion: 2.20 time: 0.416647 Jun 21 08:25:17.752352 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 479/1021] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:17 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1722 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:18.771728 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-34d0998e-37fb-4ec9-97fe-a84f112d1a92 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:18.772336 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-34d0998e-37fb-4ec9-97fe-a84f112d1a92 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:18.779837 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-34d0998e-37fb-4ec9-97fe-a84f112d1a92 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:18.779837 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-34d0998e-37fb-4ec9-97fe-a84f112d1a92 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:18.780563 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-34d0998e-37fb-4ec9-97fe-a84f112d1a92 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:18.781004 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-34d0998e-37fb-4ec9-97fe-a84f112d1a92 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:18.913269 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-34d0998e-37fb-4ec9-97fe-a84f112d1a92 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:18.922498 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-34d0998e-37fb-4ec9-97fe-a84f112d1a92 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:18.924240 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-34d0998e-37fb-4ec9-97fe-a84f112d1a92 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:18.925463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-34d0998e-37fb-4ec9-97fe-a84f112d1a92 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1665 microversion: 2.20 time: 0.157611 Jun 21 08:25:18.926039 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 543/1022] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:18 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:18.943712 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-35fd26e1-0136-4284-97d7-910865716acb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f6d12e4-4ea9-47fa-8113-27892be41ec7"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:25:18.944772 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-35fd26e1-0136-4284-97d7-910865716acb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:18.951794 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-35fd26e1-0136-4284-97d7-910865716acb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:18.952238 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-35fd26e1-0136-4284-97d7-910865716acb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:18.953002 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-35fd26e1-0136-4284-97d7-910865716acb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:18.953434 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-35fd26e1-0136-4284-97d7-910865716acb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:19.236571 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-35fd26e1-0136-4284-97d7-910865716acb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "POST /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296942 Jun 21 08:25:19.237205 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 480/1023] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Jun 21 08:25:18 2022] POST /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 08:25:19.363189 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-23c087c3-a431-458b-92b7-f7423ed8865f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:19.363688 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-23c087c3-a431-458b-92b7-f7423ed8865f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:19.370819 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-23c087c3-a431-458b-92b7-f7423ed8865f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:19.371195 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-23c087c3-a431-458b-92b7-f7423ed8865f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:19.371978 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-23c087c3-a431-458b-92b7-f7423ed8865f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:19.372422 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-23c087c3-a431-458b-92b7-f7423ed8865f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:19.635803 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-23c087c3-a431-458b-92b7-f7423ed8865f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/os-volume_attachments/5f6d12e4-4ea9-47fa-8113-27892be41ec7" status: 202 len: 0 microversion: 2.20 time: 0.276317 Jun 21 08:25:19.636309 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 544/1024] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Jun 21 08:25:19 2022] DELETE /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/os-volume_attachments/5f6d12e4-4ea9-47fa-8113-27892be41ec7 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:25:19.693660 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a2f4d7b7-4e9b-4e10-b7f6-804e75e7b61a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:25:19.694218 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a2f4d7b7-4e9b-4e10-b7f6-804e75e7b61a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:19.700543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a2f4d7b7-4e9b-4e10-b7f6-804e75e7b61a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:19.700983 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a2f4d7b7-4e9b-4e10-b7f6-804e75e7b61a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:19.701754 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a2f4d7b7-4e9b-4e10-b7f6-804e75e7b61a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:19.702178 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a2f4d7b7-4e9b-4e10-b7f6-804e75e7b61a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:19.799948 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a2f4d7b7-4e9b-4e10-b7f6-804e75e7b61a tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "POST /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/action" status: 202 len: 0 microversion: 2.20 time: 0.110237 Jun 21 08:25:19.800623 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 481/1025] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 21 08:25:19 2022] POST /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:25:19.809244 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f5499949-7b62-49be-9809-c326c4c69574 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:19.809840 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f5499949-7b62-49be-9809-c326c4c69574 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:19.817114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f5499949-7b62-49be-9809-c326c4c69574 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:19.817558 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f5499949-7b62-49be-9809-c326c4c69574 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:19.818327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f5499949-7b62-49be-9809-c326c4c69574 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:19.818872 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f5499949-7b62-49be-9809-c326c4c69574 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:19.972723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f5499949-7b62-49be-9809-c326c4c69574 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:19.983514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f5499949-7b62-49be-9809-c326c4c69574 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:19.985012 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f5499949-7b62-49be-9809-c326c4c69574 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:19.986199 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f5499949-7b62-49be-9809-c326c4c69574 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1673 microversion: 2.20 time: 0.181254 Jun 21 08:25:20.002842 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 545/1026] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:19 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:20.558944 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-3b10d572-f826-4567-9eac-a1e6dfaa45da req-d5c4f32c-25d1-4cb6-891f-07ffcd51fcbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fda813-f341-4923-a4f9-5025f6790375", "name": "network-vif-unplugged", "status": "completed", "tag": "1d991028-ab62-4ec9-81b9-b98c925870ae"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:25:20.567286 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-3b10d572-f826-4567-9eac-a1e6dfaa45da req-d5c4f32c-25d1-4cb6-891f-07ffcd51fcbd service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:20.567974 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-3b10d572-f826-4567-9eac-a1e6dfaa45da req-d5c4f32c-25d1-4cb6-891f-07ffcd51fcbd service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:20.583528 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-3b10d572-f826-4567-9eac-a1e6dfaa45da req-d5c4f32c-25d1-4cb6-891f-07ffcd51fcbd service nova] Creating event network-vif-unplugged:1d991028-ab62-4ec9-81b9-b98c925870ae for instance b5fda813-f341-4923-a4f9-5025f6790375 on hv-cinder-83697 Jun 21 08:25:20.588510 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-3b10d572-f826-4567-9eac-a1e6dfaa45da req-d5c4f32c-25d1-4cb6-891f-07ffcd51fcbd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034852 Jun 21 08:25:20.589297 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 482/1027] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:25:21.014447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-eda7ab8d-d1fd-4bce-8ff9-f5ba94b200ab tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:21.015742 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-eda7ab8d-d1fd-4bce-8ff9-f5ba94b200ab tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:21.022490 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eda7ab8d-d1fd-4bce-8ff9-f5ba94b200ab tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:21.023002 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eda7ab8d-d1fd-4bce-8ff9-f5ba94b200ab tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:21.023781 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eda7ab8d-d1fd-4bce-8ff9-f5ba94b200ab tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:21.024211 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-eda7ab8d-d1fd-4bce-8ff9-f5ba94b200ab tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:21.221552 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-eda7ab8d-d1fd-4bce-8ff9-f5ba94b200ab tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:21.230814 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-eda7ab8d-d1fd-4bce-8ff9-f5ba94b200ab tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:21.232330 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-eda7ab8d-d1fd-4bce-8ff9-f5ba94b200ab tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:21.233536 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-eda7ab8d-d1fd-4bce-8ff9-f5ba94b200ab tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.223293 Jun 21 08:25:21.234089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 546/1028] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:21 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:22.255209 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3fdbf0d2-8e61-4330-b19a-dbd82011eae6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:22.255917 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3fdbf0d2-8e61-4330-b19a-dbd82011eae6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:22.263804 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fdbf0d2-8e61-4330-b19a-dbd82011eae6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:22.264349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fdbf0d2-8e61-4330-b19a-dbd82011eae6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:22.265130 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fdbf0d2-8e61-4330-b19a-dbd82011eae6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:22.265561 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3fdbf0d2-8e61-4330-b19a-dbd82011eae6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:22.412580 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3fdbf0d2-8e61-4330-b19a-dbd82011eae6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:22.421781 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3fdbf0d2-8e61-4330-b19a-dbd82011eae6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:22.423335 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3fdbf0d2-8e61-4330-b19a-dbd82011eae6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:22.424515 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3fdbf0d2-8e61-4330-b19a-dbd82011eae6 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.174944 Jun 21 08:25:22.425084 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 483/1029] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:22 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:23.443755 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1bb3fb01-cf5b-4e65-81e6-1e2f967be205 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:23.444371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1bb3fb01-cf5b-4e65-81e6-1e2f967be205 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:23.452825 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb01-cf5b-4e65-81e6-1e2f967be205 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:23.453288 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb01-cf5b-4e65-81e6-1e2f967be205 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:23.454082 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb01-cf5b-4e65-81e6-1e2f967be205 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:23.454528 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb01-cf5b-4e65-81e6-1e2f967be205 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:23.608343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1bb3fb01-cf5b-4e65-81e6-1e2f967be205 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:23.617221 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1bb3fb01-cf5b-4e65-81e6-1e2f967be205 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:23.619372 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1bb3fb01-cf5b-4e65-81e6-1e2f967be205 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:23.620988 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1bb3fb01-cf5b-4e65-81e6-1e2f967be205 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.181200 Jun 21 08:25:23.621554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 547/1030] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:23 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:24.640411 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e136a0c6-a760-4f3a-afa9-7e98dc7e8d12 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:24.641007 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e136a0c6-a760-4f3a-afa9-7e98dc7e8d12 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:24.647932 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e136a0c6-a760-4f3a-afa9-7e98dc7e8d12 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:24.648690 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e136a0c6-a760-4f3a-afa9-7e98dc7e8d12 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:24.649493 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e136a0c6-a760-4f3a-afa9-7e98dc7e8d12 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:24.649967 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-e136a0c6-a760-4f3a-afa9-7e98dc7e8d12 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:24.799587 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e136a0c6-a760-4f3a-afa9-7e98dc7e8d12 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:24.810760 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e136a0c6-a760-4f3a-afa9-7e98dc7e8d12 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:24.812313 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e136a0c6-a760-4f3a-afa9-7e98dc7e8d12 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:24.813511 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e136a0c6-a760-4f3a-afa9-7e98dc7e8d12 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.177274 Jun 21 08:25:24.825275 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 484/1031] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:24 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:25.832093 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-954af5eb-727c-43a2-b775-06f996f05f87 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:25.832731 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-954af5eb-727c-43a2-b775-06f996f05f87 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:25.840655 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-954af5eb-727c-43a2-b775-06f996f05f87 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:25.841114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-954af5eb-727c-43a2-b775-06f996f05f87 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:25.841897 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-954af5eb-727c-43a2-b775-06f996f05f87 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:25.842336 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-954af5eb-727c-43a2-b775-06f996f05f87 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:25.988863 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-954af5eb-727c-43a2-b775-06f996f05f87 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:25.998424 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-954af5eb-727c-43a2-b775-06f996f05f87 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:26.000083 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-954af5eb-727c-43a2-b775-06f996f05f87 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:26.001349 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-954af5eb-727c-43a2-b775-06f996f05f87 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.173245 Jun 21 08:25:26.002169 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 548/1032] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:25 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:27.019863 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2662f54d-c5ea-4fd7-957e-e4740c889bbb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:27.020470 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2662f54d-c5ea-4fd7-957e-e4740c889bbb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:27.027345 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2662f54d-c5ea-4fd7-957e-e4740c889bbb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:27.027797 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2662f54d-c5ea-4fd7-957e-e4740c889bbb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:27.028573 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2662f54d-c5ea-4fd7-957e-e4740c889bbb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:27.029008 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2662f54d-c5ea-4fd7-957e-e4740c889bbb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:27.174457 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2662f54d-c5ea-4fd7-957e-e4740c889bbb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:27.183995 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2662f54d-c5ea-4fd7-957e-e4740c889bbb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:27.186074 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2662f54d-c5ea-4fd7-957e-e4740c889bbb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:27.187308 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2662f54d-c5ea-4fd7-957e-e4740c889bbb tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.171434 Jun 21 08:25:27.189114 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 485/1033] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:27 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:28.205723 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0f774e09-1917-4506-a136-f5150639ae07 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:28.206754 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0f774e09-1917-4506-a136-f5150639ae07 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:28.215019 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0f774e09-1917-4506-a136-f5150639ae07 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:28.215464 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0f774e09-1917-4506-a136-f5150639ae07 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:28.216230 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0f774e09-1917-4506-a136-f5150639ae07 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:28.216740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0f774e09-1917-4506-a136-f5150639ae07 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:28.363251 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0f774e09-1917-4506-a136-f5150639ae07 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:28.374077 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0f774e09-1917-4506-a136-f5150639ae07 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:28.376702 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-0f774e09-1917-4506-a136-f5150639ae07 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:28.378011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0f774e09-1917-4506-a136-f5150639ae07 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.176283 Jun 21 08:25:28.385444 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 549/1034] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:28 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:29.399136 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3ff061ef-0ad8-4313-8aef-4960e0104c5f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:29.400363 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3ff061ef-0ad8-4313-8aef-4960e0104c5f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:29.407257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3ff061ef-0ad8-4313-8aef-4960e0104c5f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:29.407703 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3ff061ef-0ad8-4313-8aef-4960e0104c5f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:29.408462 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3ff061ef-0ad8-4313-8aef-4960e0104c5f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:29.408899 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3ff061ef-0ad8-4313-8aef-4960e0104c5f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:29.427617 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:29.541405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3ff061ef-0ad8-4313-8aef-4960e0104c5f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:29.549354 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3ff061ef-0ad8-4313-8aef-4960e0104c5f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:29.550877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3ff061ef-0ad8-4313-8aef-4960e0104c5f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:29.552037 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3ff061ef-0ad8-4313-8aef-4960e0104c5f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.156821 Jun 21 08:25:29.552601 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 486/1035] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:29 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:30.571472 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-1aca591e-2015-4aab-a689-423864e5c751 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:30.574079 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-1aca591e-2015-4aab-a689-423864e5c751 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:30.580380 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1aca591e-2015-4aab-a689-423864e5c751 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:30.580835 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1aca591e-2015-4aab-a689-423864e5c751 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:30.581692 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1aca591e-2015-4aab-a689-423864e5c751 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:30.582124 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-1aca591e-2015-4aab-a689-423864e5c751 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:30.736171 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1aca591e-2015-4aab-a689-423864e5c751 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:30.744603 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1aca591e-2015-4aab-a689-423864e5c751 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:30.746165 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-1aca591e-2015-4aab-a689-423864e5c751 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:30.747411 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-1aca591e-2015-4aab-a689-423864e5c751 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.179944 Jun 21 08:25:30.747973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 550/1036] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:30 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:31.765434 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-37103af2-7588-4706-93a5-22cdbe253707 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:31.766024 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-37103af2-7588-4706-93a5-22cdbe253707 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:31.772630 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-37103af2-7588-4706-93a5-22cdbe253707 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:31.773071 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-37103af2-7588-4706-93a5-22cdbe253707 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:31.773833 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-37103af2-7588-4706-93a5-22cdbe253707 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:31.774259 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-37103af2-7588-4706-93a5-22cdbe253707 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:31.914961 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-37103af2-7588-4706-93a5-22cdbe253707 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:31.923867 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-37103af2-7588-4706-93a5-22cdbe253707 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:31.925401 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-37103af2-7588-4706-93a5-22cdbe253707 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:31.926587 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-37103af2-7588-4706-93a5-22cdbe253707 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.165099 Jun 21 08:25:31.927169 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 487/1037] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:31 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:25:32.945789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-05427544-08fe-4a57-8ae9-fcfe2801cbe1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:32.946447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-05427544-08fe-4a57-8ae9-fcfe2801cbe1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:32.953670 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-05427544-08fe-4a57-8ae9-fcfe2801cbe1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:32.954270 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-05427544-08fe-4a57-8ae9-fcfe2801cbe1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:32.955088 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-05427544-08fe-4a57-8ae9-fcfe2801cbe1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:32.955520 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-05427544-08fe-4a57-8ae9-fcfe2801cbe1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:33.099948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-05427544-08fe-4a57-8ae9-fcfe2801cbe1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:33.108904 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-05427544-08fe-4a57-8ae9-fcfe2801cbe1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:33.110441 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-05427544-08fe-4a57-8ae9-fcfe2801cbe1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:33.111640 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-05427544-08fe-4a57-8ae9-fcfe2801cbe1 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.170094 Jun 21 08:25:33.112203 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 551/1038] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:32 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:34.131564 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d3a3f837-5818-464e-8352-5d84fe460d29 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:34.132163 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d3a3f837-5818-464e-8352-5d84fe460d29 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:34.140287 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3a3f837-5818-464e-8352-5d84fe460d29 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:34.140737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3a3f837-5818-464e-8352-5d84fe460d29 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:34.141550 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3a3f837-5818-464e-8352-5d84fe460d29 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:34.141996 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3a3f837-5818-464e-8352-5d84fe460d29 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:34.295892 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d3a3f837-5818-464e-8352-5d84fe460d29 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:34.304060 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d3a3f837-5818-464e-8352-5d84fe460d29 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:34.305568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d3a3f837-5818-464e-8352-5d84fe460d29 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:34.307380 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d3a3f837-5818-464e-8352-5d84fe460d29 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.180084 Jun 21 08:25:34.307943 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 488/1039] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:34 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:34.673037 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-57b23981-ce59-41e7-99ca-8f451dbafce9 req-3ab10eab-0945-4497-b49d-ab5b5162da08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fda813-f341-4923-a4f9-5025f6790375", "name": "network-vif-plugged", "status": "completed", "tag": "1d991028-ab62-4ec9-81b9-b98c925870ae"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:25:34.684470 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-57b23981-ce59-41e7-99ca-8f451dbafce9 req-3ab10eab-0945-4497-b49d-ab5b5162da08 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:34.684990 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-57b23981-ce59-41e7-99ca-8f451dbafce9 req-3ab10eab-0945-4497-b49d-ab5b5162da08 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:34.704390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-57b23981-ce59-41e7-99ca-8f451dbafce9 req-3ab10eab-0945-4497-b49d-ab5b5162da08 service nova] Creating event network-vif-plugged:1d991028-ab62-4ec9-81b9-b98c925870ae for instance b5fda813-f341-4923-a4f9-5025f6790375 on hv-cinder-83697 Jun 21 08:25:34.710011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-57b23981-ce59-41e7-99ca-8f451dbafce9 req-3ab10eab-0945-4497-b49d-ab5b5162da08 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040668 Jun 21 08:25:34.710643 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 552/1040] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:25:35.326225 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-968463a1-91d4-4655-931f-a3533be7600f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:35.326888 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-968463a1-91d4-4655-931f-a3533be7600f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:35.333877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-968463a1-91d4-4655-931f-a3533be7600f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:35.334330 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-968463a1-91d4-4655-931f-a3533be7600f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:35.335109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-968463a1-91d4-4655-931f-a3533be7600f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:35.335586 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-968463a1-91d4-4655-931f-a3533be7600f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:35.484937 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-968463a1-91d4-4655-931f-a3533be7600f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:35.494255 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-968463a1-91d4-4655-931f-a3533be7600f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:35.496536 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-968463a1-91d4-4655-931f-a3533be7600f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:35.498068 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-968463a1-91d4-4655-931f-a3533be7600f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.176208 Jun 21 08:25:35.498650 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 489/1041] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:35 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:36.519685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-56af9c49-ec79-43fb-9961-cb5730895dc9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:36.520396 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-56af9c49-ec79-43fb-9961-cb5730895dc9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:36.529544 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-56af9c49-ec79-43fb-9961-cb5730895dc9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:36.529929 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-56af9c49-ec79-43fb-9961-cb5730895dc9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:36.530900 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-56af9c49-ec79-43fb-9961-cb5730895dc9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:36.531426 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-56af9c49-ec79-43fb-9961-cb5730895dc9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:36.698418 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-56af9c49-ec79-43fb-9961-cb5730895dc9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:36.707537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-56af9c49-ec79-43fb-9961-cb5730895dc9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:36.709240 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-56af9c49-ec79-43fb-9961-cb5730895dc9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:36.710392 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-56af9c49-ec79-43fb-9961-cb5730895dc9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1731 microversion: 2.20 time: 0.196745 Jun 21 08:25:36.711214 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 553/1042] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:36 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:25:37.729722 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-22af4afb-41fe-4b5c-96fb-e463ffc0e007 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:25:37.735100 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-22af4afb-41fe-4b5c-96fb-e463ffc0e007 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:25:37.740838 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-22af4afb-41fe-4b5c-96fb-e463ffc0e007 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:37.741279 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-22af4afb-41fe-4b5c-96fb-e463ffc0e007 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:37.742052 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-22af4afb-41fe-4b5c-96fb-e463ffc0e007 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:25:37.742475 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-22af4afb-41fe-4b5c-96fb-e463ffc0e007 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:25:37.895486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-22af4afb-41fe-4b5c-96fb-e463ffc0e007 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:37.905018 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-22af4afb-41fe-4b5c-96fb-e463ffc0e007 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:37.906641 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-22af4afb-41fe-4b5c-96fb-e463ffc0e007 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:25:37.907855 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-22af4afb-41fe-4b5c-96fb-e463ffc0e007 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1718 microversion: 2.20 time: 0.182436 Jun 21 08:25:37.908528 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 490/1043] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:25:37 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1718 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 08:26:07.336858 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-3f0e9926-ccb4-4419-aed8-af57b0d16b23 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:26:07.337809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-3f0e9926-ccb4-4419-aed8-af57b0d16b23 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:26:07.340620 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=27 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:07.341314 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:07.347475 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3f0e9926-ccb4-4419-aed8-af57b0d16b23 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:07.347921 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3f0e9926-ccb4-4419-aed8-af57b0d16b23 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:07.348693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3f0e9926-ccb4-4419-aed8-af57b0d16b23 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:07.349132 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-3f0e9926-ccb4-4419-aed8-af57b0d16b23 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:07.393135 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-3f0e9926-ccb4-4419-aed8-af57b0d16b23 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061556 Jun 21 08:26:07.394146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 554/1044] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 21 08:26:07 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:26:07.467002 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f5a567d1-101e-4395-9356-a02bad433c94 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:26:07.467597 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f5a567d1-101e-4395-9356-a02bad433c94 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:26:07.469684 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=27 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:07.470349 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=26 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:07.476196 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f5a567d1-101e-4395-9356-a02bad433c94 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:07.476644 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f5a567d1-101e-4395-9356-a02bad433c94 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:07.477420 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f5a567d1-101e-4395-9356-a02bad433c94 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:07.477853 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-f5a567d1-101e-4395-9356-a02bad433c94 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:07.506049 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f5a567d1-101e-4395-9356-a02bad433c94 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:26:07.595230 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f5a567d1-101e-4395-9356-a02bad433c94 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 204 len: 0 microversion: 2.20 time: 0.132558 Jun 21 08:26:07.595945 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 491/1045] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 21 08:26:07 2022] DELETE /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 08:26:07.604971 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a858ff63-08b3-4a55-b999-9d4fd120d81f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:26:07.605583 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a858ff63-08b3-4a55-b999-9d4fd120d81f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:26:07.611697 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a858ff63-08b3-4a55-b999-9d4fd120d81f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:07.612145 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a858ff63-08b3-4a55-b999-9d4fd120d81f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:07.612905 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a858ff63-08b3-4a55-b999-9d4fd120d81f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:07.613340 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a858ff63-08b3-4a55-b999-9d4fd120d81f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:07.745669 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a858ff63-08b3-4a55-b999-9d4fd120d81f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:26:07.754002 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a858ff63-08b3-4a55-b999-9d4fd120d81f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:26:07.755809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a858ff63-08b3-4a55-b999-9d4fd120d81f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:26:07.756974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a858ff63-08b3-4a55-b999-9d4fd120d81f tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.156462 Jun 21 08:26:07.757533 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 555/1046] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:26:07 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:26:08.898041 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-88a6d038-1d45-475b-9b5d-73f65a793254 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:26:08.898783 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-88a6d038-1d45-475b-9b5d-73f65a793254 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:26:08.905025 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88a6d038-1d45-475b-9b5d-73f65a793254 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:08.905475 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88a6d038-1d45-475b-9b5d-73f65a793254 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:08.906246 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88a6d038-1d45-475b-9b5d-73f65a793254 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:08.906701 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-88a6d038-1d45-475b-9b5d-73f65a793254 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:09.126799 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-88a6d038-1d45-475b-9b5d-73f65a793254 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:26:09.135787 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-88a6d038-1d45-475b-9b5d-73f65a793254 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:26:09.137263 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-88a6d038-1d45-475b-9b5d-73f65a793254 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bc6e732127845a6be56f9b8be728f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:26:09.138458 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-88a6d038-1d45-475b-9b5d-73f65a793254 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 200 len: 1724 microversion: 2.20 time: 0.366329 Jun 21 08:26:09.139177 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 492/1047] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:26:08 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 08:26:09.948891 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-57e2f77c-9cf7-4ebe-9ba2-b11de0423f6c req-8ad0c758-0238-4f71-9397-610b6c6961a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fda813-f341-4923-a4f9-5025f6790375", "name": "network-vif-deleted", "tag": "1d991028-ab62-4ec9-81b9-b98c925870ae"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:26:09.965110 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-57e2f77c-9cf7-4ebe-9ba2-b11de0423f6c req-8ad0c758-0238-4f71-9397-610b6c6961a4 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:09.965559 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-57e2f77c-9cf7-4ebe-9ba2-b11de0423f6c req-8ad0c758-0238-4f71-9397-610b6c6961a4 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:09.980515 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-57e2f77c-9cf7-4ebe-9ba2-b11de0423f6c req-8ad0c758-0238-4f71-9397-610b6c6961a4 service nova] Creating event network-vif-deleted:1d991028-ab62-4ec9-81b9-b98c925870ae for instance b5fda813-f341-4923-a4f9-5025f6790375 on hv-cinder-83697 Jun 21 08:26:09.988192 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-57e2f77c-9cf7-4ebe-9ba2-b11de0423f6c req-8ad0c758-0238-4f71-9397-610b6c6961a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119084 Jun 21 08:26:09.989092 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 556/1048] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:26:10.159297 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1d5f6a0c-f6dc-4418-857b-2302f6f56329 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:26:10.160599 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1d5f6a0c-f6dc-4418-857b-2302f6f56329 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:26:10.169741 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1d5f6a0c-f6dc-4418-857b-2302f6f56329 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:10.170097 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1d5f6a0c-f6dc-4418-857b-2302f6f56329 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:10.170900 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1d5f6a0c-f6dc-4418-857b-2302f6f56329 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:10.171356 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1d5f6a0c-f6dc-4418-857b-2302f6f56329 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:10.185788 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-1d5f6a0c-f6dc-4418-857b-2302f6f56329 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] HTTP exception thrown: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1d5f6a0c-f6dc-4418-857b-2302f6f56329 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Request method failure captured: Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 HTTP/1.1 Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX92Qos4PjD4nrb9Z-KMrynfFbiGinrocNE8y8creAPk98nGSUgNkMhTFfREXCAaFbYBYGmBW9F3klfN0MnLDZvJ0aDwfKrxSgc2dEwcpw-zdm9f22FSP0d8K32MZ_P0xzgEc5EWmjO6zeLGGjWCsaGmsCGxHJ4CmhIRW2YMFKCU-d4 Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:26:10.187503 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_df68cafb6dcd4a8c9e9593d3f13500f0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 2bc6e732127845a6be56f9b8be728f14 Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:10.189864 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'b5fda813-f341-4923-a4f9-5025f6790375'} Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:26:10.191226 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:10.192894 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:10.194502 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1d5f6a0c-f6dc-4418-857b-2302f6f56329 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Returning 404 to user: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:26:10.194502 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1d5f6a0c-f6dc-4418-857b-2302f6f56329 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 404 len: 111 microversion: 2.20 time: 0.034296 Jun 21 08:26:10.199257 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-69a54543-d508-4128-8ab5-7b307ad2d31b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '.version_select at 0x7fded2ffaaf0>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:26:10.202427 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 493/1049] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:26:10 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 08:26:10.219129 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-69a54543-d508-4128-8ab5-7b307ad2d31b tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028437079" status: 204 len: 0 microversion: 2.20 time: 0.024416 Jun 21 08:26:10.219532 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 557/1050] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Jun 21 08:26:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028437079 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 08:26:12.111590 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-68ed6383-94ad-4dd1-b536-6565b221ac83 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:26:12.112159 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-68ed6383-94ad-4dd1-b536-6565b221ac83 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:26:12.122872 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-68ed6383-94ad-4dd1-b536-6565b221ac83 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:12.123582 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-68ed6383-94ad-4dd1-b536-6565b221ac83 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:12.124812 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-68ed6383-94ad-4dd1-b536-6565b221ac83 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:12.125257 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-68ed6383-94ad-4dd1-b536-6565b221ac83 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:12.139424 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-68ed6383-94ad-4dd1-b536-6565b221ac83 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] HTTP exception thrown: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-68ed6383-94ad-4dd1-b536-6565b221ac83 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Request method failure captured: Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: DELETE /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 HTTP/1.1 Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX92Qos4PjD4nrb9Z-KMrynfFbiGinrocNE8y8creAPk98nGSUgNkMhTFfREXCAaFbYBYGmBW9F3klfN0MnLDZvJ0aDwfKrxSgc2dEwcpw-zdm9f22FSP0d8K32MZ_P0xzgEc5EWmjO6zeLGGjWCsaGmsCGxHJ4CmhIRW2YMFKCU-d4 Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:26:12.141004 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_df68cafb6dcd4a8c9e9593d3f13500f0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 2bc6e732127845a6be56f9b8be728f14 Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:12.142687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'b5fda813-f341-4923-a4f9-5025f6790375'} Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:26:12.143627 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:12.145195 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:12.146720 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-68ed6383-94ad-4dd1-b536-6565b221ac83 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Returning 404 to user: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:26:12.146720 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-68ed6383-94ad-4dd1-b536-6565b221ac83 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 404 len: 111 microversion: 2.20 time: 0.034768 Jun 21 08:26:12.146720 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 494/1051] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 21 08:26:12 2022] DELETE /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 08:26:12.153324 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d94c2a6e-192c-4b4d-a881-c7dd64941ff9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:26:12.154064 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d94c2a6e-192c-4b4d-a881-c7dd64941ff9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: b5fda813-f341-4923-a4f9-5025f6790375] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:26:12.160525 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d94c2a6e-192c-4b4d-a881-c7dd64941ff9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:12.160974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d94c2a6e-192c-4b4d-a881-c7dd64941ff9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:12.161754 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d94c2a6e-192c-4b4d-a881-c7dd64941ff9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:12.162197 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d94c2a6e-192c-4b4d-a881-c7dd64941ff9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:12.179612 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-d94c2a6e-192c-4b4d-a881-c7dd64941ff9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] HTTP exception thrown: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d94c2a6e-192c-4b4d-a881-c7dd64941ff9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Request method failure captured: Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 HTTP/1.1 Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX92Qos4PjD4nrb9Z-KMrynfFbiGinrocNE8y8creAPk98nGSUgNkMhTFfREXCAaFbYBYGmBW9F3klfN0MnLDZvJ0aDwfKrxSgc2dEwcpw-zdm9f22FSP0d8K32MZ_P0xzgEc5EWmjO6zeLGGjWCsaGmsCGxHJ4CmhIRW2YMFKCU-d4 Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:26:12.181327 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_df68cafb6dcd4a8c9e9593d3f13500f0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 2bc6e732127845a6be56f9b8be728f14 Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:12.183317 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'b5fda813-f341-4923-a4f9-5025f6790375'} Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:26:12.184960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. Jun 21 08:26:12.187086 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:26:12.188685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d94c2a6e-192c-4b4d-a881-c7dd64941ff9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Returning 404 to user: Instance b5fda813-f341-4923-a4f9-5025f6790375 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:26:12.188685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d94c2a6e-192c-4b4d-a881-c7dd64941ff9 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375" status: 404 len: 111 microversion: 2.20 time: 0.034871 Jun 21 08:26:12.188685 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 558/1052] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:26:12 2022] GET /compute/v2.1/servers/b5fda813-f341-4923-a4f9-5025f6790375 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 21 08:26:13.333976 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c5ea53a9-7e73-4eed-bb45-22c9a25bc999 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:26:13.334574 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c5ea53a9-7e73-4eed-bb45-22c9a25bc999 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:26:13.342511 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5ea53a9-7e73-4eed-bb45-22c9a25bc999 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:13.342994 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5ea53a9-7e73-4eed-bb45-22c9a25bc999 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:13.343788 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5ea53a9-7e73-4eed-bb45-22c9a25bc999 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:13.344232 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c5ea53a9-7e73-4eed-bb45-22c9a25bc999 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:13.362044 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-c5ea53a9-7e73-4eed-bb45-22c9a25bc999 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] HTTP exception thrown: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c5ea53a9-7e73-4eed-bb45-22c9a25bc999 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Request method failure captured: Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: DELETE /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa HTTP/1.1 Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisX92Qos4PjD4nrb9Z-KMrynfFbiGinrocNE8y8creAPk98nGSUgNkMhTFfREXCAaFbYBYGmBW9F3klfN0MnLDZvJ0aDwfKrxSgc2dEwcpw-zdm9f22FSP0d8K32MZ_P0xzgEc5EWmjO6zeLGGjWCsaGmsCGxHJ4CmhIRW2YMFKCU-d4 Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:26:13.363708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_df68cafb6dcd4a8c9e9593d3f13500f0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 2bc6e732127845a6be56f9b8be728f14 Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:26:13.365486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': 'c679db4c-d2f2-4b89-8027-39078f9bf5aa'} Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:26:13.366404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:26:13.367764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:26:13.369424 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c5ea53a9-7e73-4eed-bb45-22c9a25bc999 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Returning 404 to user: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:26:13.369424 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c5ea53a9-7e73-4eed-bb45-22c9a25bc999 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 404 len: 111 microversion: 2.20 time: 0.035178 Jun 21 08:26:13.369424 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 495/1053] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 21 08:26:13 2022] DELETE /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 08:26:13.375321 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0c7102f5-ec02-4ed3-af22-59b4427ce968 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:26:13.376177 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-0c7102f5-ec02-4ed3-af22-59b4427ce968 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] [instance: c679db4c-d2f2-4b89-8027-39078f9bf5aa] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:26:13.384450 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c7102f5-ec02-4ed3-af22-59b4427ce968 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:13.384940 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c7102f5-ec02-4ed3-af22-59b4427ce968 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:13.385992 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c7102f5-ec02-4ed3-af22-59b4427ce968 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:26:13.386484 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-0c7102f5-ec02-4ed3-af22-59b4427ce968 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:26:13.402463 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-0c7102f5-ec02-4ed3-af22-59b4427ce968 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] HTTP exception thrown: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0c7102f5-ec02-4ed3-af22-59b4427ce968 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Request method failure captured: Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa HTTP/1.1 Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisX92Qos4PjD4nrb9Z-KMrynfFbiGinrocNE8y8creAPk98nGSUgNkMhTFfREXCAaFbYBYGmBW9F3klfN0MnLDZvJ0aDwfKrxSgc2dEwcpw-zdm9f22FSP0d8K32MZ_P0xzgEc5EWmjO6zeLGGjWCsaGmsCGxHJ4CmhIRW2YMFKCU-d4 Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:26:13.404098 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/df68cafb6dcd4a8c9e9593d3f13500f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_df68cafb6dcd4a8c9e9593d3f13500f0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: df68cafb6dcd4a8c9e9593d3f13500f0 Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1685273886 Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 2bc6e732127845a6be56f9b8be728f14 Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1685273886-project Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:26:13.405818 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': 'c679db4c-d2f2-4b89-8027-39078f9bf5aa'} Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:26:13.406785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. Jun 21 08:26:13.408318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:26:13.410120 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-0c7102f5-ec02-4ed3-af22-59b4427ce968 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] Returning 404 to user: Instance c679db4c-d2f2-4b89-8027-39078f9bf5aa could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:26:13.410120 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-0c7102f5-ec02-4ed3-af22-59b4427ce968 tempest-AttachVolumeShelveTestJSON-1685273886 tempest-AttachVolumeShelveTestJSON-1685273886-project] 10.222.0.36 "GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa" status: 404 len: 111 microversion: 2.20 time: 0.034854 Jun 21 08:26:13.410120 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 559/1054] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 08:26:13 2022] GET /compute/v2.1/servers/c679db4c-d2f2-4b89-8027-39078f9bf5aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 08:27:16.444802 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:16.445650 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:16.740268 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7957b320-5586-4996-b023-4eb5f75091fd tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Action: 'create', calling method: .version_select at 0x7fded2ffcb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-971519085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrfwpMJ0eog2Ha8N1WVPWDg6nZU+r4BdHxHariIBzO86r0l8RtV+2sJNf7XC9qLrSrrRm+EoUgF3UDQqYS4KL/x4ENnfAz2TVg186IYaofo45jMhg1SER3kT4fLA7FKcQ=="}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:27:16.769365 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-7957b320-5586-4996-b023-4eb5f75091fd tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Getting quotas for project b65afb27ab304161aaa6aabe73c1c58e. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:27:16.777657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-7957b320-5586-4996-b023-4eb5f75091fd tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Getting quotas for user 7c428bd4817a40de8a378aa0935ae764 and project b65afb27ab304161aaa6aabe73c1c58e. Resources: {'key_pairs'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:27:16.812661 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7957b320-5586-4996-b023-4eb5f75091fd tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.376796 Jun 21 08:27:16.813568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 496/1055] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 08:27:16 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:27:31.342298 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:31.343081 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=18 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:31.347476 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-540893665", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-971519085", "security_groups": [{"name": "tempest-secgroup-smoke-354442512"}], "block_device_mapping_v2": [{"uuid": "9c90d928-848a-487b-a082-84e0d921a42a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7527f918-94ee-4fed-a095-5260a615dead"}]}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:27:31.478097 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] validate_networks() for [('7527f918-94ee-4fed-a095-5260a615dead', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:27:32.000804 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:27:32.001284 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:27:32.001785 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:27:32.002190 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:27:32.002598 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:27:32.013206 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:32.014929 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:32.014929 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:32.014929 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:32.032499 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Getting quotas for project b65afb27ab304161aaa6aabe73c1c58e. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:27:32.036683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Getting quotas for user 7c428bd4817a40de8a378aa0935ae764 and project b65afb27ab304161aaa6aabe73c1c58e. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:27:32.103261 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:27:32.105589 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c90d928-848a-487b-a082-84e0d921a42a',volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:27:32.252912 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-42aa88c7-3db4-464b-ada0-23f68e8d4764 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.912168 Jun 21 08:27:32.254018 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 560/1056] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:27:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:27:32.266504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-84390061-dc4c-4656-b869-0646c48c17a4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:32.267281 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-84390061-dc4c-4656-b869-0646c48c17a4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:32.270356 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=4 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:32.271123 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:32.337842 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-84390061-dc4c-4656-b869-0646c48c17a4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:32.346508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-84390061-dc4c-4656-b869-0646c48c17a4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1093 microversion: 2.1 time: 0.084508 Jun 21 08:27:32.347324 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 497/1057] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:32 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1093 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:33.364394 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9b6d7857-6a38-45ff-9c92-29501397084f tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:33.365768 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9b6d7857-6a38-45ff-9c92-29501397084f tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:33.373691 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9b6d7857-6a38-45ff-9c92-29501397084f tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:33.373974 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9b6d7857-6a38-45ff-9c92-29501397084f tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:33.375005 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9b6d7857-6a38-45ff-9c92-29501397084f tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:33.375431 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9b6d7857-6a38-45ff-9c92-29501397084f tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:33.468151 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9b6d7857-6a38-45ff-9c92-29501397084f tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:33.487853 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9b6d7857-6a38-45ff-9c92-29501397084f tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1209 microversion: 2.1 time: 0.127663 Jun 21 08:27:33.488675 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 561/1058] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:33 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1209 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:27:34.507144 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d9d0e02d-0395-4302-b767-a93b61f65983 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:34.507781 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d9d0e02d-0395-4302-b767-a93b61f65983 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:34.516191 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d9d0e02d-0395-4302-b767-a93b61f65983 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:34.516824 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d9d0e02d-0395-4302-b767-a93b61f65983 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:34.517628 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d9d0e02d-0395-4302-b767-a93b61f65983 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:34.518073 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d9d0e02d-0395-4302-b767-a93b61f65983 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:34.880648 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d9d0e02d-0395-4302-b767-a93b61f65983 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:34.890968 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d9d0e02d-0395-4302-b767-a93b61f65983 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.389205 Jun 21 08:27:34.891786 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 498/1059] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:34 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:35.248210 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-18ecfc99-17e7-4726-89ed-1d88a26e6746 req-c44afced-3ea7-459f-9f1e-5244ba6935e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5158b74b-28fa-4edc-b88e-ec99a87d0416", "tag": "33083afc-432e-45aa-a5b5-eaaa51fe0f10"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:27:35.263468 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-18ecfc99-17e7-4726-89ed-1d88a26e6746 req-c44afced-3ea7-459f-9f1e-5244ba6935e3 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:35.264473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-18ecfc99-17e7-4726-89ed-1d88a26e6746 req-c44afced-3ea7-459f-9f1e-5244ba6935e3 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:35.289567 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-18ecfc99-17e7-4726-89ed-1d88a26e6746 req-c44afced-3ea7-459f-9f1e-5244ba6935e3 service nova] Creating event network-changed:33083afc-432e-45aa-a5b5-eaaa51fe0f10 for instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 on hv-cinder-83697 Jun 21 08:27:35.296034 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-18ecfc99-17e7-4726-89ed-1d88a26e6746 req-c44afced-3ea7-459f-9f1e-5244ba6935e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056088 Jun 21 08:27:35.296826 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 562/1060] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:27:35.908985 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-cd9567ab-af40-4b34-88f4-1f02dda76c64 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:35.909549 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-cd9567ab-af40-4b34-88f4-1f02dda76c64 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:35.916593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cd9567ab-af40-4b34-88f4-1f02dda76c64 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:35.917047 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cd9567ab-af40-4b34-88f4-1f02dda76c64 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:35.917833 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cd9567ab-af40-4b34-88f4-1f02dda76c64 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:35.918276 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cd9567ab-af40-4b34-88f4-1f02dda76c64 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:36.137196 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-cd9567ab-af40-4b34-88f4-1f02dda76c64 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:36.145687 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-cd9567ab-af40-4b34-88f4-1f02dda76c64 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.240676 Jun 21 08:27:36.146307 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 499/1061] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:35 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:37.164074 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-656d5dca-25d9-407d-b67a-8f90c9b0acd9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:37.164783 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-656d5dca-25d9-407d-b67a-8f90c9b0acd9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:37.171151 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-656d5dca-25d9-407d-b67a-8f90c9b0acd9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:37.171603 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-656d5dca-25d9-407d-b67a-8f90c9b0acd9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:37.172371 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-656d5dca-25d9-407d-b67a-8f90c9b0acd9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:37.172836 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-656d5dca-25d9-407d-b67a-8f90c9b0acd9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:37.303107 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-656d5dca-25d9-407d-b67a-8f90c9b0acd9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:37.311466 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-656d5dca-25d9-407d-b67a-8f90c9b0acd9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.152845 Jun 21 08:27:37.312023 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 563/1062] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:37 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:38.329046 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a6fef408-bfdc-4199-9a23-033b8f965319 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:38.329655 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a6fef408-bfdc-4199-9a23-033b8f965319 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:38.337054 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a6fef408-bfdc-4199-9a23-033b8f965319 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:38.337489 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a6fef408-bfdc-4199-9a23-033b8f965319 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:38.338286 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a6fef408-bfdc-4199-9a23-033b8f965319 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:38.338744 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a6fef408-bfdc-4199-9a23-033b8f965319 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:38.479091 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a6fef408-bfdc-4199-9a23-033b8f965319 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:38.486602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a6fef408-bfdc-4199-9a23-033b8f965319 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.161393 Jun 21 08:27:38.487591 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 500/1063] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:38 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:39.504263 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-21fc1877-eada-4677-9248-e64e99a50c1d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:39.504877 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-21fc1877-eada-4677-9248-e64e99a50c1d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:39.511725 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-21fc1877-eada-4677-9248-e64e99a50c1d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:39.512173 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-21fc1877-eada-4677-9248-e64e99a50c1d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:39.512973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-21fc1877-eada-4677-9248-e64e99a50c1d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:39.513409 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-21fc1877-eada-4677-9248-e64e99a50c1d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:39.646268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-21fc1877-eada-4677-9248-e64e99a50c1d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:39.654770 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-21fc1877-eada-4677-9248-e64e99a50c1d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.154525 Jun 21 08:27:39.655341 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 564/1064] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:39 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:40.673048 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bf5dda62-a7d0-4832-a7e6-ccde323d11a7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:40.673657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bf5dda62-a7d0-4832-a7e6-ccde323d11a7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:40.680398 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bf5dda62-a7d0-4832-a7e6-ccde323d11a7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:40.680850 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bf5dda62-a7d0-4832-a7e6-ccde323d11a7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:40.681602 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bf5dda62-a7d0-4832-a7e6-ccde323d11a7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:40.682026 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bf5dda62-a7d0-4832-a7e6-ccde323d11a7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:40.816644 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bf5dda62-a7d0-4832-a7e6-ccde323d11a7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:40.825044 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bf5dda62-a7d0-4832-a7e6-ccde323d11a7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.155781 Jun 21 08:27:40.825552 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 501/1065] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:40 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:27:41.843055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-952763be-3064-42c9-83c3-3e25f95ff9e7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:41.843618 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-952763be-3064-42c9-83c3-3e25f95ff9e7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:41.850829 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-952763be-3064-42c9-83c3-3e25f95ff9e7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:41.851280 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-952763be-3064-42c9-83c3-3e25f95ff9e7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:41.852061 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-952763be-3064-42c9-83c3-3e25f95ff9e7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:41.852494 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-952763be-3064-42c9-83c3-3e25f95ff9e7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:41.994084 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-952763be-3064-42c9-83c3-3e25f95ff9e7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:42.001678 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-952763be-3064-42c9-83c3-3e25f95ff9e7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.162726 Jun 21 08:27:42.002244 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 565/1066] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:41 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:43.018480 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-4ecdb214-7c2e-4147-9fae-b2de2503564b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:43.019101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-4ecdb214-7c2e-4147-9fae-b2de2503564b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:43.021470 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:43.027387 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ecdb214-7c2e-4147-9fae-b2de2503564b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:43.027835 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ecdb214-7c2e-4147-9fae-b2de2503564b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:43.028600 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ecdb214-7c2e-4147-9fae-b2de2503564b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:43.029029 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-4ecdb214-7c2e-4147-9fae-b2de2503564b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:43.166101 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-4ecdb214-7c2e-4147-9fae-b2de2503564b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:43.174022 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-4ecdb214-7c2e-4147-9fae-b2de2503564b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.159556 Jun 21 08:27:43.174598 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 502/1067] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:43 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:44.191519 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8a4a1b8b-82bb-4822-9e9e-319466823d1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:44.192114 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8a4a1b8b-82bb-4822-9e9e-319466823d1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:44.194651 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:44.195318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=6 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:44.201789 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8a4a1b8b-82bb-4822-9e9e-319466823d1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:44.202233 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8a4a1b8b-82bb-4822-9e9e-319466823d1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:44.203024 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8a4a1b8b-82bb-4822-9e9e-319466823d1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:44.203454 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8a4a1b8b-82bb-4822-9e9e-319466823d1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:44.336860 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8a4a1b8b-82bb-4822-9e9e-319466823d1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:44.344469 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8a4a1b8b-82bb-4822-9e9e-319466823d1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.156804 Jun 21 08:27:44.345028 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 566/1068] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:44 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:45.346533 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-beec5e08-ee0c-4d97-98c3-db7aa93d8cdf req-a37c4335-9433-4234-a8b4-dec80105d167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5158b74b-28fa-4edc-b88e-ec99a87d0416", "name": "network-vif-plugged", "status": "completed", "tag": "33083afc-432e-45aa-a5b5-eaaa51fe0f10"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:27:45.355691 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-beec5e08-ee0c-4d97-98c3-db7aa93d8cdf req-a37c4335-9433-4234-a8b4-dec80105d167 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:45.356146 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-beec5e08-ee0c-4d97-98c3-db7aa93d8cdf req-a37c4335-9433-4234-a8b4-dec80105d167 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:45.361270 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-4dad5697-69be-40ba-9bb0-fb554c03ec57 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:45.361883 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-4dad5697-69be-40ba-9bb0-fb554c03ec57 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:45.368423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-beec5e08-ee0c-4d97-98c3-db7aa93d8cdf req-a37c4335-9433-4234-a8b4-dec80105d167 service nova] Creating event network-vif-plugged:33083afc-432e-45aa-a5b5-eaaa51fe0f10 for instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 on hv-cinder-83697 Jun 21 08:27:45.372612 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4dad5697-69be-40ba-9bb0-fb554c03ec57 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:45.373093 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4dad5697-69be-40ba-9bb0-fb554c03ec57 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:45.373601 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-beec5e08-ee0c-4d97-98c3-db7aa93d8cdf req-a37c4335-9433-4234-a8b4-dec80105d167 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090449 Jun 21 08:27:45.373876 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4dad5697-69be-40ba-9bb0-fb554c03ec57 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:45.374310 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 503/1069] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:27:45.374729 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-4dad5697-69be-40ba-9bb0-fb554c03ec57 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:45.519312 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-4dad5697-69be-40ba-9bb0-fb554c03ec57 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:45.527243 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-4dad5697-69be-40ba-9bb0-fb554c03ec57 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.169745 Jun 21 08:27:45.527828 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 567/1070] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:45 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:46.545979 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2b732c73-1b3a-4c88-a9f5-29a7d659dd37 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:46.546676 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2b732c73-1b3a-4c88-a9f5-29a7d659dd37 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:46.553625 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2b732c73-1b3a-4c88-a9f5-29a7d659dd37 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:46.554079 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2b732c73-1b3a-4c88-a9f5-29a7d659dd37 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:46.554881 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2b732c73-1b3a-4c88-a9f5-29a7d659dd37 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:46.555317 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2b732c73-1b3a-4c88-a9f5-29a7d659dd37 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:46.702012 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2b732c73-1b3a-4c88-a9f5-29a7d659dd37 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:46.709847 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2b732c73-1b3a-4c88-a9f5-29a7d659dd37 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1264 microversion: 2.1 time: 0.168926 Jun 21 08:27:46.710417 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 504/1071] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:46 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:47.727344 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b6c0e430-15fd-43fa-8e10-789d139086e0 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:47.727939 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b6c0e430-15fd-43fa-8e10-789d139086e0 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:47.734545 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6c0e430-15fd-43fa-8e10-789d139086e0 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:47.735045 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6c0e430-15fd-43fa-8e10-789d139086e0 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:47.735821 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6c0e430-15fd-43fa-8e10-789d139086e0 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:47.736265 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6c0e430-15fd-43fa-8e10-789d139086e0 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:47.872387 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b6c0e430-15fd-43fa-8e10-789d139086e0 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:47.880979 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b6c0e430-15fd-43fa-8e10-789d139086e0 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1451 microversion: 2.1 time: 0.157539 Jun 21 08:27:47.881563 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 568/1072] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:47 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:47.897792 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-10192119-2b4d-45ef-91c3-185295e9a3b9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:27:47.898402 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-10192119-2b4d-45ef-91c3-185295e9a3b9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:27:47.905038 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-10192119-2b4d-45ef-91c3-185295e9a3b9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:47.905483 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-10192119-2b4d-45ef-91c3-185295e9a3b9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:47.906259 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-10192119-2b4d-45ef-91c3-185295e9a3b9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:47.906724 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-10192119-2b4d-45ef-91c3-185295e9a3b9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:48.047059 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-10192119-2b4d-45ef-91c3-185295e9a3b9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:27:48.055085 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-10192119-2b4d-45ef-91c3-185295e9a3b9 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1451 microversion: 2.1 time: 0.161795 Jun 21 08:27:48.055672 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 505/1073] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:27:47 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:27:49.771000 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-81977fe9-198f-4a67-bc40-c95cbcc8cc91 req-4483a1fc-e777-437f-81d3-1a0685c6b250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5158b74b-28fa-4edc-b88e-ec99a87d0416", "tag": "33083afc-432e-45aa-a5b5-eaaa51fe0f10"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:27:49.782216 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-81977fe9-198f-4a67-bc40-c95cbcc8cc91 req-4483a1fc-e777-437f-81d3-1a0685c6b250 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:27:49.784090 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-81977fe9-198f-4a67-bc40-c95cbcc8cc91 req-4483a1fc-e777-437f-81d3-1a0685c6b250 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:27:49.794712 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-81977fe9-198f-4a67-bc40-c95cbcc8cc91 req-4483a1fc-e777-437f-81d3-1a0685c6b250 service nova] Creating event network-changed:33083afc-432e-45aa-a5b5-eaaa51fe0f10 for instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 on hv-cinder-83697 Jun 21 08:27:49.800762 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-81977fe9-198f-4a67-bc40-c95cbcc8cc91 req-4483a1fc-e777-437f-81d3-1a0685c6b250 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033536 Jun 21 08:27:49.801516 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 569/1074] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:28:47.736967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:28:47.737700 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Tue Jun 21 08:28:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:29:43.963695 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=20 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:29:43.964447 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=44 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:29:43.968538 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-67efcee3-a7cd-4a70-a5af-fc546e89a125 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:43.969036 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-67efcee3-a7cd-4a70-a5af-fc546e89a125 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:43.975759 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-67efcee3-a7cd-4a70-a5af-fc546e89a125 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:43.976210 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-67efcee3-a7cd-4a70-a5af-fc546e89a125 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:43.976970 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-67efcee3-a7cd-4a70-a5af-fc546e89a125 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:43.977404 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-67efcee3-a7cd-4a70-a5af-fc546e89a125 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:44.001871 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-67efcee3-a7cd-4a70-a5af-fc546e89a125 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Going to try to terminate instance {{(pid=117548) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:29:44.078902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-67efcee3-a7cd-4a70-a5af-fc546e89a125 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 204 len: 0 microversion: 2.1 time: 0.116789 Jun 21 08:29:44.079551 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 506/1075] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:29:43 2022] DELETE /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:29:44.087100 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d58d627f-0903-4bd4-9155-2aba26bb1e99] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 21 08:29:44.087751 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:29:44.088528 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=48 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:29:44.093228 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-d0a3cc53-24df-4222-9661-826f8f37bae1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:44.093926 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-d0a3cc53-24df-4222-9661-826f8f37bae1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:44.103055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0a3cc53-24df-4222-9661-826f8f37bae1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:44.103664 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0a3cc53-24df-4222-9661-826f8f37bae1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:44.104447 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0a3cc53-24df-4222-9661-826f8f37bae1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:44.104889 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-d0a3cc53-24df-4222-9661-826f8f37bae1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:44.257736 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-d0a3cc53-24df-4222-9661-826f8f37bae1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:44.265628 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-d0a3cc53-24df-4222-9661-826f8f37bae1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1575 microversion: 2.1 time: 0.180771 Jun 21 08:29:44.266183 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 570/1076] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:44 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:45.285233 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bd1ea8f1-681b-4f14-8181-534114f648db tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:45.285940 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bd1ea8f1-681b-4f14-8181-534114f648db tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:45.292680 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd1ea8f1-681b-4f14-8181-534114f648db tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:45.293124 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd1ea8f1-681b-4f14-8181-534114f648db tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:45.293891 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd1ea8f1-681b-4f14-8181-534114f648db tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:45.294321 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bd1ea8f1-681b-4f14-8181-534114f648db tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:45.434858 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bd1ea8f1-681b-4f14-8181-534114f648db tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:45.445395 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bd1ea8f1-681b-4f14-8181-534114f648db tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1575 microversion: 2.1 time: 0.165226 Jun 21 08:29:45.445984 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 507/1077] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:45 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:46.446037 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-ab7857da-5fe5-4fd6-b1e2-cf617e956b8b req-54b5652b-43ac-4621-8af3-b17b9698d2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5158b74b-28fa-4edc-b88e-ec99a87d0416", "name": "network-vif-deleted", "tag": "33083afc-432e-45aa-a5b5-eaaa51fe0f10"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:29:46.462419 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-ab7857da-5fe5-4fd6-b1e2-cf617e956b8b req-54b5652b-43ac-4621-8af3-b17b9698d2dd service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:46.463740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-ab7857da-5fe5-4fd6-b1e2-cf617e956b8b req-54b5652b-43ac-4621-8af3-b17b9698d2dd service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:46.467433 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-b364f6b4-f3e0-41be-b614-7a4c3b56c282 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:46.468508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-b364f6b4-f3e0-41be-b614-7a4c3b56c282 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:46.481364 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b364f6b4-f3e0-41be-b614-7a4c3b56c282 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:46.482149 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b364f6b4-f3e0-41be-b614-7a4c3b56c282 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:46.483586 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b364f6b4-f3e0-41be-b614-7a4c3b56c282 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:46.484660 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-b364f6b4-f3e0-41be-b614-7a4c3b56c282 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:46.509720 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO oslo.messaging._drivers.impl_rabbit [-] [d58d627f-0903-4bd4-9155-2aba26bb1e99] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45522. Jun 21 08:29:46.519054 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-ab7857da-5fe5-4fd6-b1e2-cf617e956b8b req-54b5652b-43ac-4621-8af3-b17b9698d2dd service nova] Creating event network-vif-deleted:33083afc-432e-45aa-a5b5-eaaa51fe0f10 for instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 on hv-cinder-83697 Jun 21 08:29:46.527072 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-ab7857da-5fe5-4fd6-b1e2-cf617e956b8b req-54b5652b-43ac-4621-8af3-b17b9698d2dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084027 Jun 21 08:29:46.538352 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 571/1078] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:29:46.587249 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-b364f6b4-f3e0-41be-b614-7a4c3b56c282 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:46.598682 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-b364f6b4-f3e0-41be-b614-7a4c3b56c282 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 200 len: 1508 microversion: 2.1 time: 0.135787 Jun 21 08:29:46.599318 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 508/1079] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:46 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 1508 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:47.617796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b9c30e68-86b8-4a1b-bf7b-7f26d09daca7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:47.619120 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b9c30e68-86b8-4a1b-bf7b-7f26d09daca7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:47.624640 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b9c30e68-86b8-4a1b-bf7b-7f26d09daca7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:47.625089 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b9c30e68-86b8-4a1b-bf7b-7f26d09daca7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:47.625858 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b9c30e68-86b8-4a1b-bf7b-7f26d09daca7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:47.626297 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b9c30e68-86b8-4a1b-bf7b-7f26d09daca7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:47.641702 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-b9c30e68-86b8-4a1b-bf7b-7f26d09daca7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] HTTP exception thrown: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b9c30e68-86b8-4a1b-bf7b-7f26d09daca7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Request method failure captured: Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 HTTP/1.1 Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisYDfJjTaUR207PCDqfr-b1CjvN0NJo1VZnCOFA3crwR3v4t7NvoTutpYtsz_jvyLp4Wwtk-1x4x8ZFQfOr1cgk9pWfXLnbs1jZVRxWast3E8guknN8i1JT3UpQ83IMgIPWGcps_OLLac8UY1TsgFOk4H0S6QjUPFwzs0nHsKbbamr-4 Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: b65afb27ab304161aaa6aabe73c1c58e Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:29:47.643967 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b65afb27ab304161aaa6aabe73c1c58e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: b65afb27ab304161aaa6aabe73c1c58e Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-TestVolumeBootPattern-1242211373-project Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 7c428bd4817a40de8a378aa0935ae764 Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-TestVolumeBootPattern-1242211373-project Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:29:47.645741 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '5158b74b-28fa-4edc-b88e-ec99a87d0416'} Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:29:47.646832 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:29:47.648501 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:29:47.649991 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b9c30e68-86b8-4a1b-bf7b-7f26d09daca7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Returning 404 to user: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:29:47.649991 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b9c30e68-86b8-4a1b-bf7b-7f26d09daca7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 404 len: 111 microversion: 2.1 time: 0.033812 Jun 21 08:29:47.649991 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 572/1080] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:47 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:29:47.693708 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1044749077", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-971519085", "security_groups": [{"name": "tempest-secgroup-smoke-354442512"}], "block_device_mapping_v2": [{"uuid": "9c90d928-848a-487b-a082-84e0d921a42a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7527f918-94ee-4fed-a095-5260a615dead"}]}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:29:47.817589 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.network.neutron [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] validate_networks() for [('7527f918-94ee-4fed-a095-5260a615dead', None, None, None, None, None)] {{(pid=117548) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:29:48.281152 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Flavor limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:29:48.281579 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Image limits 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:29:48.282056 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Flavor pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:29:48.282465 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Image pref 0:0:0 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:29:48.282903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.virt.hardware [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:29:48.292114 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:48.292565 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:48.293369 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:48.293812 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:48.311355 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Getting quotas for project b65afb27ab304161aaa6aabe73c1c58e. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:29:48.315829 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.quota [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Getting quotas for user 7c428bd4817a40de8a378aa0935ae764 and project b65afb27ab304161aaa6aabe73c1c58e. Resources: {'ram', 'cores', 'instances'} {{(pid=117548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:29:48.372124 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Going to run 1 instances... {{(pid=117548) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:29:48.374196 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c90d928-848a-487b-a082-84e0d921a42a',volume_size=None,volume_type=None)] {{(pid=117548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:29:48.504041 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-cd5e2d74-9c65-4e5f-88db-3b77f4e96d19 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.814519 Jun 21 08:29:48.504691 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 509/1081] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:29:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:29:48.514797 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9f339579-1dae-4e32-bfbb-c69aca1fe8a6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:48.515506 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9f339579-1dae-4e32-bfbb-c69aca1fe8a6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:48.571653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9f339579-1dae-4e32-bfbb-c69aca1fe8a6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:48.579170 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9f339579-1dae-4e32-bfbb-c69aca1fe8a6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1094 microversion: 2.1 time: 0.068200 Jun 21 08:29:48.579740 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 573/1082] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:48 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:49.597350 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-f75a588a-b79a-47d7-a270-3f46a081601d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:49.597974 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-f75a588a-b79a-47d7-a270-3f46a081601d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:49.654959 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-f75a588a-b79a-47d7-a270-3f46a081601d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:49.663461 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-f75a588a-b79a-47d7-a270-3f46a081601d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1094 microversion: 2.1 time: 0.071168 Jun 21 08:29:49.664053 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 510/1083] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:49 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:50.687272 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-27ff4b4a-6c3c-4603-9b3d-977b68457c13 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:50.687925 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-27ff4b4a-6c3c-4603-9b3d-977b68457c13 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:50.746300 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-27ff4b4a-6c3c-4603-9b3d-977b68457c13 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:50.753765 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-27ff4b4a-6c3c-4603-9b3d-977b68457c13 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1094 microversion: 2.1 time: 0.070246 Jun 21 08:29:50.754318 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 574/1084] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:50 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:51.771243 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-de740dae-22e3-4543-be3c-72532c72dc1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:51.772200 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-de740dae-22e3-4543-be3c-72532c72dc1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:51.837568 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-de740dae-22e3-4543-be3c-72532c72dc1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:51.844322 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-de740dae-22e3-4543-be3c-72532c72dc1a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1094 microversion: 2.1 time: 0.077695 Jun 21 08:29:51.844885 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 511/1085] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:51 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:52.866429 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-8743a97c-a28f-4a03-b65c-fad5a8ac5664 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:52.867011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-8743a97c-a28f-4a03-b65c-fad5a8ac5664 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:52.873583 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8743a97c-a28f-4a03-b65c-fad5a8ac5664 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:52.874029 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8743a97c-a28f-4a03-b65c-fad5a8ac5664 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:52.874834 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8743a97c-a28f-4a03-b65c-fad5a8ac5664 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:52.875283 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-8743a97c-a28f-4a03-b65c-fad5a8ac5664 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:52.946833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-8743a97c-a28f-4a03-b65c-fad5a8ac5664 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:52.954899 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-8743a97c-a28f-4a03-b65c-fad5a8ac5664 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1144 microversion: 2.1 time: 0.092375 Jun 21 08:29:52.955499 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 575/1086] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:52 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:53.978431 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2037d479-a4f7-4aab-9d41-46d6b5855585 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:53.979109 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-2037d479-a4f7-4aab-9d41-46d6b5855585 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:53.985379 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2037d479-a4f7-4aab-9d41-46d6b5855585 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:53.985833 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2037d479-a4f7-4aab-9d41-46d6b5855585 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:53.986692 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2037d479-a4f7-4aab-9d41-46d6b5855585 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:53.987127 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-2037d479-a4f7-4aab-9d41-46d6b5855585 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:54.079267 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-2037d479-a4f7-4aab-9d41-46d6b5855585 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:54.086889 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2037d479-a4f7-4aab-9d41-46d6b5855585 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1210 microversion: 2.1 time: 0.112811 Jun 21 08:29:54.087547 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 512/1087] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:53 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:54.915022 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-02e3ab0b-1928-4ca8-96db-918bcd8a6cdc req-8e06154d-218f-4d54-808d-cf2b31f722ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a93ac5-4e57-4836-8b57-95728223391c", "tag": "39d9a614-e9a7-4ce7-bf0f-995b5ce17ecf"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:29:54.924385 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-02e3ab0b-1928-4ca8-96db-918bcd8a6cdc req-8e06154d-218f-4d54-808d-cf2b31f722ec service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:54.925386 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-02e3ab0b-1928-4ca8-96db-918bcd8a6cdc req-8e06154d-218f-4d54-808d-cf2b31f722ec service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:54.955795 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-02e3ab0b-1928-4ca8-96db-918bcd8a6cdc req-8e06154d-218f-4d54-808d-cf2b31f722ec service nova] Creating event network-changed:39d9a614-e9a7-4ce7-bf0f-995b5ce17ecf for instance 29a93ac5-4e57-4836-8b57-95728223391c on hv-cinder-83697 Jun 21 08:29:54.961709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-02e3ab0b-1928-4ca8-96db-918bcd8a6cdc req-8e06154d-218f-4d54-808d-cf2b31f722ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050255 Jun 21 08:29:54.962397 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 576/1088] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:29:55.109220 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-52dc3529-c544-4566-acbe-fb123e279472 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:55.109881 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-52dc3529-c544-4566-acbe-fb123e279472 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:55.116879 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-52dc3529-c544-4566-acbe-fb123e279472 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:55.117327 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-52dc3529-c544-4566-acbe-fb123e279472 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:55.118104 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-52dc3529-c544-4566-acbe-fb123e279472 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:55.118543 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-52dc3529-c544-4566-acbe-fb123e279472 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:55.348759 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-52dc3529-c544-4566-acbe-fb123e279472 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:55.356261 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-52dc3529-c544-4566-acbe-fb123e279472 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.250995 Jun 21 08:29:55.357062 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 513/1089] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:55 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:56.374239 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-160a3f38-ce99-4fb7-8d54-39204b69e2bb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:56.374965 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-160a3f38-ce99-4fb7-8d54-39204b69e2bb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:56.382011 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-160a3f38-ce99-4fb7-8d54-39204b69e2bb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:56.382449 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-160a3f38-ce99-4fb7-8d54-39204b69e2bb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:56.383244 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-160a3f38-ce99-4fb7-8d54-39204b69e2bb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:56.383678 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-160a3f38-ce99-4fb7-8d54-39204b69e2bb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:56.517794 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-160a3f38-ce99-4fb7-8d54-39204b69e2bb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:56.525321 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-160a3f38-ce99-4fb7-8d54-39204b69e2bb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.155805 Jun 21 08:29:56.525948 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 577/1090] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:56 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:57.542088 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-dcc6143e-77ef-475f-a228-016853a0be3e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:57.542812 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-dcc6143e-77ef-475f-a228-016853a0be3e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:57.550358 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dcc6143e-77ef-475f-a228-016853a0be3e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:57.550837 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dcc6143e-77ef-475f-a228-016853a0be3e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:57.551609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dcc6143e-77ef-475f-a228-016853a0be3e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:57.552045 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-dcc6143e-77ef-475f-a228-016853a0be3e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:57.699179 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-dcc6143e-77ef-475f-a228-016853a0be3e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:57.707926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-dcc6143e-77ef-475f-a228-016853a0be3e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.169666 Jun 21 08:29:57.708501 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 514/1091] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:57 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:58.724796 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b1eb0775-494e-4cef-aae2-a755d3337d4e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:58.725446 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b1eb0775-494e-4cef-aae2-a755d3337d4e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:58.732085 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1eb0775-494e-4cef-aae2-a755d3337d4e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:58.732535 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1eb0775-494e-4cef-aae2-a755d3337d4e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:58.733302 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1eb0775-494e-4cef-aae2-a755d3337d4e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:58.733738 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b1eb0775-494e-4cef-aae2-a755d3337d4e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:58.864331 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b1eb0775-494e-4cef-aae2-a755d3337d4e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:29:58.871815 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b1eb0775-494e-4cef-aae2-a755d3337d4e tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.151629 Jun 21 08:29:58.872370 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 578/1092] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:58 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:29:59.889326 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-14839b0e-9c73-44fe-9757-918085fe0b43 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:29:59.889988 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-14839b0e-9c73-44fe-9757-918085fe0b43 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:29:59.891967 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:29:59.899045 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-14839b0e-9c73-44fe-9757-918085fe0b43 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:59.899513 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-14839b0e-9c73-44fe-9757-918085fe0b43 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:29:59.900348 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-14839b0e-9c73-44fe-9757-918085fe0b43 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:29:59.900791 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-14839b0e-9c73-44fe-9757-918085fe0b43 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:00.040281 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-14839b0e-9c73-44fe-9757-918085fe0b43 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:30:00.048841 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-14839b0e-9c73-44fe-9757-918085fe0b43 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.163537 Jun 21 08:30:00.049609 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 515/1093] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:29:59 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:30:01.068662 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6f77cef4-89fa-489f-88a7-6539547845b1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:30:01.069259 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6f77cef4-89fa-489f-88a7-6539547845b1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:30:01.071679 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=4 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:30:01.077249 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6f77cef4-89fa-489f-88a7-6539547845b1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:01.077694 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6f77cef4-89fa-489f-88a7-6539547845b1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:01.078458 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6f77cef4-89fa-489f-88a7-6539547845b1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:01.079054 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6f77cef4-89fa-489f-88a7-6539547845b1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:01.222325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-6f77cef4-89fa-489f-88a7-6539547845b1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:30:01.229943 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6f77cef4-89fa-489f-88a7-6539547845b1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.165187 Jun 21 08:30:01.232964 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 579/1094] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:30:01 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:30:02.248836 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-3f883397-7111-41af-988f-503d38ee5889 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:30:02.249443 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-3f883397-7111-41af-988f-503d38ee5889 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:30:02.252528 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=10 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:30:02.257977 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3f883397-7111-41af-988f-503d38ee5889 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:02.258431 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3f883397-7111-41af-988f-503d38ee5889 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:02.259235 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3f883397-7111-41af-988f-503d38ee5889 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:02.259672 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-3f883397-7111-41af-988f-503d38ee5889 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:02.400106 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-3f883397-7111-41af-988f-503d38ee5889 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:30:02.408026 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-3f883397-7111-41af-988f-503d38ee5889 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.162704 Jun 21 08:30:02.408594 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 516/1095] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:30:02 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:30:03.425778 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-6eeec0e6-5269-4ae8-803f-8f2223a4f0f7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:30:03.426343 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-6eeec0e6-5269-4ae8-803f-8f2223a4f0f7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:30:03.433621 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6eeec0e6-5269-4ae8-803f-8f2223a4f0f7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:03.434076 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6eeec0e6-5269-4ae8-803f-8f2223a4f0f7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:03.434865 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6eeec0e6-5269-4ae8-803f-8f2223a4f0f7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:03.435294 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-6eeec0e6-5269-4ae8-803f-8f2223a4f0f7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:03.577732 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-6eeec0e6-5269-4ae8-803f-8f2223a4f0f7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:30:03.589057 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-6eeec0e6-5269-4ae8-803f-8f2223a4f0f7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.167901 Jun 21 08:30:03.589874 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 580/1096] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:30:03 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:30:04.606994 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-41866832-01b9-4565-91dc-172b0470b1a2 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:30:04.607643 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-41866832-01b9-4565-91dc-172b0470b1a2 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:30:04.615857 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-41866832-01b9-4565-91dc-172b0470b1a2 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:04.616305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-41866832-01b9-4565-91dc-172b0470b1a2 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:04.617078 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-41866832-01b9-4565-91dc-172b0470b1a2 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:04.617510 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-41866832-01b9-4565-91dc-172b0470b1a2 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:04.767131 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-41866832-01b9-4565-91dc-172b0470b1a2 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:30:04.774423 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-41866832-01b9-4565-91dc-172b0470b1a2 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.171307 Jun 21 08:30:04.775051 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 517/1097] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:30:04 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:30:05.791601 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-ec47a224-76fa-4487-bec5-4365592312ad tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:30:05.792277 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-ec47a224-76fa-4487-bec5-4365592312ad tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:30:05.800055 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ec47a224-76fa-4487-bec5-4365592312ad tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:05.800513 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ec47a224-76fa-4487-bec5-4365592312ad tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:05.801297 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ec47a224-76fa-4487-bec5-4365592312ad tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:05.801733 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-ec47a224-76fa-4487-bec5-4365592312ad tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:05.942444 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-ec47a224-76fa-4487-bec5-4365592312ad tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:30:05.950952 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-ec47a224-76fa-4487-bec5-4365592312ad tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.163014 Jun 21 08:30:05.956586 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 581/1098] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:30:05 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:30:05.981654 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-b050c8be-315f-4e67-8c0f-50484ec89170 req-e3f836e6-058b-4074-b5e5-30d1574a5457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a93ac5-4e57-4836-8b57-95728223391c", "name": "network-vif-plugged", "status": "completed", "tag": "39d9a614-e9a7-4ce7-bf0f-995b5ce17ecf"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:30:05.992405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-b050c8be-315f-4e67-8c0f-50484ec89170 req-e3f836e6-058b-4074-b5e5-30d1574a5457 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:05.992936 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-b050c8be-315f-4e67-8c0f-50484ec89170 req-e3f836e6-058b-4074-b5e5-30d1574a5457 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:06.005902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-b050c8be-315f-4e67-8c0f-50484ec89170 req-e3f836e6-058b-4074-b5e5-30d1574a5457 service nova] Creating event network-vif-plugged:39d9a614-e9a7-4ce7-bf0f-995b5ce17ecf for instance 29a93ac5-4e57-4836-8b57-95728223391c on hv-cinder-83697 Jun 21 08:30:06.011438 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-b050c8be-315f-4e67-8c0f-50484ec89170 req-e3f836e6-058b-4074-b5e5-30d1574a5457 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033635 Jun 21 08:30:06.012070 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 518/1099] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:30:06.968949 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-453c93c7-71a7-4354-ba93-921c01e39190 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:30:06.969563 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-453c93c7-71a7-4354-ba93-921c01e39190 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:30:06.976351 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-453c93c7-71a7-4354-ba93-921c01e39190 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:06.976795 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-453c93c7-71a7-4354-ba93-921c01e39190 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:06.977554 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-453c93c7-71a7-4354-ba93-921c01e39190 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:06.977980 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-453c93c7-71a7-4354-ba93-921c01e39190 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:07.118518 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-453c93c7-71a7-4354-ba93-921c01e39190 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:30:07.125972 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-453c93c7-71a7-4354-ba93-921c01e39190 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1265 microversion: 2.1 time: 0.160944 Jun 21 08:30:07.127465 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 582/1100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:30:06 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:30:08.144463 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-66545243-310d-49f9-8e67-77132f42ded1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:30:08.146025 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-66545243-310d-49f9-8e67-77132f42ded1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:30:08.152641 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-66545243-310d-49f9-8e67-77132f42ded1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:08.153094 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-66545243-310d-49f9-8e67-77132f42ded1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:08.153872 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-66545243-310d-49f9-8e67-77132f42ded1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:08.154441 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-66545243-310d-49f9-8e67-77132f42ded1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:08.294888 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-66545243-310d-49f9-8e67-77132f42ded1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:30:08.303234 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-66545243-310d-49f9-8e67-77132f42ded1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1453 microversion: 2.1 time: 0.163590 Jun 21 08:30:08.303808 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 519/1101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:30:08 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:30:08.318997 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a5d36e42-822d-48a5-89ef-7091a207f48b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:30:08.319619 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a5d36e42-822d-48a5-89ef-7091a207f48b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:30:08.326075 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a5d36e42-822d-48a5-89ef-7091a207f48b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:08.326523 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a5d36e42-822d-48a5-89ef-7091a207f48b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:08.327338 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a5d36e42-822d-48a5-89ef-7091a207f48b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:08.327772 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a5d36e42-822d-48a5-89ef-7091a207f48b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:08.466999 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a5d36e42-822d-48a5-89ef-7091a207f48b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:30:08.475556 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a5d36e42-822d-48a5-89ef-7091a207f48b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1453 microversion: 2.1 time: 0.160274 Jun 21 08:30:08.476125 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 583/1102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:30:08 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:30:10.460127 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-0de20c39-a244-4c3e-b16e-8412503ac6ff req-752fb139-8d9a-4d1c-b06a-a782d948e551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a93ac5-4e57-4836-8b57-95728223391c", "tag": "39d9a614-e9a7-4ce7-bf0f-995b5ce17ecf"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:30:10.469117 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-0de20c39-a244-4c3e-b16e-8412503ac6ff req-752fb139-8d9a-4d1c-b06a-a782d948e551 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:30:10.469566 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-0de20c39-a244-4c3e-b16e-8412503ac6ff req-752fb139-8d9a-4d1c-b06a-a782d948e551 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:30:10.481536 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-0de20c39-a244-4c3e-b16e-8412503ac6ff req-752fb139-8d9a-4d1c-b06a-a782d948e551 service nova] Creating event network-changed:39d9a614-e9a7-4ce7-bf0f-995b5ce17ecf for instance 29a93ac5-4e57-4836-8b57-95728223391c on hv-cinder-83697 Jun 21 08:30:10.487051 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-0de20c39-a244-4c3e-b16e-8412503ac6ff req-752fb139-8d9a-4d1c-b06a-a782d948e551 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096274 Jun 21 08:30:10.487666 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 520/1103] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:30:32.349630 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:30:32.350287 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Tue Jun 21 08:30:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:30:36.323109 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:30:36.323809 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Tue Jun 21 08:30:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:31:38.804539 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=32 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:31:38.805285 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=60 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:31:38.809452 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1242917542", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-971519085", "security_groups": [{"name": "tempest-secgroup-smoke-354442512"}], "block_device_mapping_v2": [{"uuid": "59f9f801-3473-40fd-9711-6f4c19162c1e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7527f918-94ee-4fed-a095-5260a615dead"}]}} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:31:39.090218 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.network.neutron [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] validate_networks() for [('7527f918-94ee-4fed-a095-5260a615dead', None, None, None, None, None)] {{(pid=117547) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 08:31:39.474187 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Flavor limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 08:31:39.474665 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Image limits 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 08:31:39.475172 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Flavor pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 08:31:39.475578 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Image pref 0:0:0 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 08:31:39.475982 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.virt.hardware [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 08:31:39.485770 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:39.486329 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:39.487161 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:39.487595 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:39.506571 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Getting quotas for project b65afb27ab304161aaa6aabe73c1c58e. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 08:31:39.510514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.quota [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Getting quotas for user 7c428bd4817a40de8a378aa0935ae764 and project b65afb27ab304161aaa6aabe73c1c58e. Resources: {'ram', 'cores', 'instances'} {{(pid=117547) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 08:31:39.573448 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Going to run 1 instances... {{(pid=117547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 08:31:39.573448 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59f9f801-3473-40fd-9711-6f4c19162c1e',volume_size=None,volume_type=None)] {{(pid=117547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 08:31:39.708871 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-720eedfc-f934-4492-a4ff-3dfdd9b0126a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.906085 Jun 21 08:31:39.709566 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 584/1104] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 08:31:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 08:31:39.717952 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:31:39.718863 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:31:39.723978 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e56b01c3-5046-4c15-90c6-bc406f891d6b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:39.724633 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-e56b01c3-5046-4c15-90c6-bc406f891d6b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:39.841593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-e56b01c3-5046-4c15-90c6-bc406f891d6b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:39.849028 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e56b01c3-5046-4c15-90c6-bc406f891d6b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1094 microversion: 2.1 time: 0.133054 Jun 21 08:31:39.849608 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 521/1105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:39 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1094 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:40.866569 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-577ab48a-fdeb-490c-87aa-94a1303b06bc tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:40.867803 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-577ab48a-fdeb-490c-87aa-94a1303b06bc tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:40.875926 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-577ab48a-fdeb-490c-87aa-94a1303b06bc tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:40.876734 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-577ab48a-fdeb-490c-87aa-94a1303b06bc tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:40.877578 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-577ab48a-fdeb-490c-87aa-94a1303b06bc tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:40.878075 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-577ab48a-fdeb-490c-87aa-94a1303b06bc tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:40.945146 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-577ab48a-fdeb-490c-87aa-94a1303b06bc tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:40.954007 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-577ab48a-fdeb-490c-87aa-94a1303b06bc tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1210 microversion: 2.1 time: 0.091865 Jun 21 08:31:40.955234 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 585/1106] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:40 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:41.972842 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c531adb3-2ebe-4872-a672-283f448e81ff tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:41.973667 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c531adb3-2ebe-4872-a672-283f448e81ff tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:41.981532 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c531adb3-2ebe-4872-a672-283f448e81ff tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:41.982019 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c531adb3-2ebe-4872-a672-283f448e81ff tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:41.982840 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c531adb3-2ebe-4872-a672-283f448e81ff tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:41.983275 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c531adb3-2ebe-4872-a672-283f448e81ff tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:42.237439 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-c531adb3-2ebe-4872-a672-283f448e81ff tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:42.248539 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c531adb3-2ebe-4872-a672-283f448e81ff tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1265 microversion: 2.1 time: 0.280302 Jun 21 08:31:42.249359 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 522/1107] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:41 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:42.287833 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [req-adbb5d5a-2b33-4f19-9c84-17dedef29699 req-e68cb7e7-e990-4997-a37a-d8b01e6b9da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba37581-60a9-4add-9c41-f660406531d8", "tag": "2185d819-c44b-47b2-89fc-f7205c083a4e"}]} {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:31:42.297027 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-adbb5d5a-2b33-4f19-9c84-17dedef29699 req-e68cb7e7-e990-4997-a37a-d8b01e6b9da9 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:42.297474 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [req-adbb5d5a-2b33-4f19-9c84-17dedef29699 req-e68cb7e7-e990-4997-a37a-d8b01e6b9da9 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:42.309456 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.compute.server_external_events [req-adbb5d5a-2b33-4f19-9c84-17dedef29699 req-e68cb7e7-e990-4997-a37a-d8b01e6b9da9 service nova] Creating event network-changed:2185d819-c44b-47b2-89fc-f7205c083a4e for instance 5ba37581-60a9-4add-9c41-f660406531d8 on hv-cinder-83697 Jun 21 08:31:42.314942 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [req-adbb5d5a-2b33-4f19-9c84-17dedef29699 req-e68cb7e7-e990-4997-a37a-d8b01e6b9da9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124443 Jun 21 08:31:42.315551 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 586/1108] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:31:43.272625 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-60d232da-0f10-45f7-a8d3-cb35a783b669 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:43.273682 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-60d232da-0f10-45f7-a8d3-cb35a783b669 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:43.281170 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60d232da-0f10-45f7-a8d3-cb35a783b669 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:43.281498 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60d232da-0f10-45f7-a8d3-cb35a783b669 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:43.282253 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60d232da-0f10-45f7-a8d3-cb35a783b669 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:43.282737 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-60d232da-0f10-45f7-a8d3-cb35a783b669 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:43.497623 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-60d232da-0f10-45f7-a8d3-cb35a783b669 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:43.506578 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-60d232da-0f10-45f7-a8d3-cb35a783b669 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1265 microversion: 2.1 time: 0.239197 Jun 21 08:31:43.507186 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 523/1109] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:43 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:44.527754 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-82eac4bd-9b8f-4d33-b7bb-4f36cf2f8cc7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:44.528462 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-82eac4bd-9b8f-4d33-b7bb-4f36cf2f8cc7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:44.535813 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82eac4bd-9b8f-4d33-b7bb-4f36cf2f8cc7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:44.536336 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82eac4bd-9b8f-4d33-b7bb-4f36cf2f8cc7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:44.537149 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82eac4bd-9b8f-4d33-b7bb-4f36cf2f8cc7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:44.537860 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-82eac4bd-9b8f-4d33-b7bb-4f36cf2f8cc7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:44.677835 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-82eac4bd-9b8f-4d33-b7bb-4f36cf2f8cc7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:44.685587 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-82eac4bd-9b8f-4d33-b7bb-4f36cf2f8cc7 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1265 microversion: 2.1 time: 0.162140 Jun 21 08:31:44.686147 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 587/1110] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:44 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:45.703545 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a81c467f-4852-49e2-b7d9-8e31f4a1b1b4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:45.704158 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-a81c467f-4852-49e2-b7d9-8e31f4a1b1b4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:45.710593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a81c467f-4852-49e2-b7d9-8e31f4a1b1b4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:45.711066 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a81c467f-4852-49e2-b7d9-8e31f4a1b1b4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:45.711859 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a81c467f-4852-49e2-b7d9-8e31f4a1b1b4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:45.712285 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-a81c467f-4852-49e2-b7d9-8e31f4a1b1b4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:45.840712 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-a81c467f-4852-49e2-b7d9-8e31f4a1b1b4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:45.848716 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a81c467f-4852-49e2-b7d9-8e31f4a1b1b4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1265 microversion: 2.1 time: 0.149351 Jun 21 08:31:45.849284 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 524/1111] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:45 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:46.865790 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-469b4498-51dd-4dd3-b209-8c3a6df7da9c tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:46.866412 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-469b4498-51dd-4dd3-b209-8c3a6df7da9c tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:46.872451 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-469b4498-51dd-4dd3-b209-8c3a6df7da9c tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:46.872897 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-469b4498-51dd-4dd3-b209-8c3a6df7da9c tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:46.873650 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-469b4498-51dd-4dd3-b209-8c3a6df7da9c tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:46.874870 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-469b4498-51dd-4dd3-b209-8c3a6df7da9c tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:47.008693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-469b4498-51dd-4dd3-b209-8c3a6df7da9c tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:47.016325 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-469b4498-51dd-4dd3-b209-8c3a6df7da9c tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1265 microversion: 2.1 time: 0.154563 Jun 21 08:31:47.016886 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 588/1112] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:46 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:48.033796 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-bec06804-15ed-4fe3-ad6c-c74b06220a2a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:48.034411 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-bec06804-15ed-4fe3-ad6c-c74b06220a2a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:48.041178 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bec06804-15ed-4fe3-ad6c-c74b06220a2a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:48.041632 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bec06804-15ed-4fe3-ad6c-c74b06220a2a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:48.042411 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bec06804-15ed-4fe3-ad6c-c74b06220a2a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:48.042877 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-bec06804-15ed-4fe3-ad6c-c74b06220a2a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:48.194291 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-bec06804-15ed-4fe3-ad6c-c74b06220a2a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:48.202916 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-bec06804-15ed-4fe3-ad6c-c74b06220a2a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1265 microversion: 2.1 time: 0.172879 Jun 21 08:31:48.203504 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 525/1113] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:48 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:49.219909 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e2b0c9f9-77f8-494f-ab99-8327e68849e8 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:49.220514 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e2b0c9f9-77f8-494f-ab99-8327e68849e8 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:49.227061 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e2b0c9f9-77f8-494f-ab99-8327e68849e8 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:49.227516 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e2b0c9f9-77f8-494f-ab99-8327e68849e8 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:49.228307 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e2b0c9f9-77f8-494f-ab99-8327e68849e8 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:49.228744 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e2b0c9f9-77f8-494f-ab99-8327e68849e8 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:49.364446 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e2b0c9f9-77f8-494f-ab99-8327e68849e8 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:49.372031 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e2b0c9f9-77f8-494f-ab99-8327e68849e8 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1265 microversion: 2.1 time: 0.156972 Jun 21 08:31:49.372596 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 589/1114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:49 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:50.389247 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8edb9b3c-81e2-4295-88dc-aea09e440576 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:50.390564 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8edb9b3c-81e2-4295-88dc-aea09e440576 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:50.392874 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=2 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:31:50.398230 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8edb9b3c-81e2-4295-88dc-aea09e440576 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:50.398694 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8edb9b3c-81e2-4295-88dc-aea09e440576 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:50.399454 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8edb9b3c-81e2-4295-88dc-aea09e440576 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:50.399882 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8edb9b3c-81e2-4295-88dc-aea09e440576 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:50.531794 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-8edb9b3c-81e2-4295-88dc-aea09e440576 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:50.539412 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8edb9b3c-81e2-4295-88dc-aea09e440576 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1265 microversion: 2.1 time: 0.154071 Jun 21 08:31:50.539990 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 526/1115] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:50 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:51.556369 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-2ddfb705-39e2-42f2-a46a-f6fde989eceb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:51.556980 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-2ddfb705-39e2-42f2-a46a-f6fde989eceb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:51.558960 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=2 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:31:51.559639 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell0:SELECT=6 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:31:51.566683 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2ddfb705-39e2-42f2-a46a-f6fde989eceb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:51.567134 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2ddfb705-39e2-42f2-a46a-f6fde989eceb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:51.567919 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2ddfb705-39e2-42f2-a46a-f6fde989eceb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:51.568351 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-2ddfb705-39e2-42f2-a46a-f6fde989eceb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:51.699046 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-2ddfb705-39e2-42f2-a46a-f6fde989eceb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:51.706493 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-2ddfb705-39e2-42f2-a46a-f6fde989eceb tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1265 microversion: 2.1 time: 0.153999 Jun 21 08:31:51.707085 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 590/1116] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:51 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:52.518683 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-757ab1c1-69e2-4219-8780-8759bd7f96f4 req-586a1011-f8d4-4c0d-a954-22ea4ab3dcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba37581-60a9-4add-9c41-f660406531d8", "name": "network-vif-plugged", "status": "completed", "tag": "2185d819-c44b-47b2-89fc-f7205c083a4e"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:31:52.527546 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-757ab1c1-69e2-4219-8780-8759bd7f96f4 req-586a1011-f8d4-4c0d-a954-22ea4ab3dcb0 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:52.527946 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-757ab1c1-69e2-4219-8780-8759bd7f96f4 req-586a1011-f8d4-4c0d-a954-22ea4ab3dcb0 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:52.541924 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-757ab1c1-69e2-4219-8780-8759bd7f96f4 req-586a1011-f8d4-4c0d-a954-22ea4ab3dcb0 service nova] Creating event network-vif-plugged:2185d819-c44b-47b2-89fc-f7205c083a4e for instance 5ba37581-60a9-4add-9c41-f660406531d8 on hv-cinder-83697 Jun 21 08:31:52.546927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-757ab1c1-69e2-4219-8780-8759bd7f96f4 req-586a1011-f8d4-4c0d-a954-22ea4ab3dcb0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032743 Jun 21 08:31:52.547774 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 527/1117] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:31:52.723433 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-b6f0ab68-af36-49b4-b7c8-2c0c9837342d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:52.724047 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-b6f0ab68-af36-49b4-b7c8-2c0c9837342d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:52.730454 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6f0ab68-af36-49b4-b7c8-2c0c9837342d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:52.730935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6f0ab68-af36-49b4-b7c8-2c0c9837342d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:52.731695 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6f0ab68-af36-49b4-b7c8-2c0c9837342d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:52.732127 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-b6f0ab68-af36-49b4-b7c8-2c0c9837342d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:52.872693 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-b6f0ab68-af36-49b4-b7c8-2c0c9837342d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:52.881177 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-b6f0ab68-af36-49b4-b7c8-2c0c9837342d tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1265 microversion: 2.1 time: 0.161693 Jun 21 08:31:52.881710 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 591/1118] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:52 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:53.899512 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-195bb2f6-f53c-4a31-949a-c033cc030079 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:53.900119 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-195bb2f6-f53c-4a31-949a-c033cc030079 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:53.906213 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-195bb2f6-f53c-4a31-949a-c033cc030079 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:53.906735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-195bb2f6-f53c-4a31-949a-c033cc030079 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:53.907488 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-195bb2f6-f53c-4a31-949a-c033cc030079 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:53.907915 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-195bb2f6-f53c-4a31-949a-c033cc030079 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:54.039898 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-195bb2f6-f53c-4a31-949a-c033cc030079 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:54.048243 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-195bb2f6-f53c-4a31-949a-c033cc030079 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1453 microversion: 2.1 time: 0.153358 Jun 21 08:31:54.048809 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 528/1119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:53 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:31:54.064578 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-e3855505-9e1b-4ba0-a593-0a40293d6c7a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:31:54.065188 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-e3855505-9e1b-4ba0-a593-0a40293d6c7a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:31:54.072820 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3855505-9e1b-4ba0-a593-0a40293d6c7a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:54.073268 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3855505-9e1b-4ba0-a593-0a40293d6c7a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:54.074406 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3855505-9e1b-4ba0-a593-0a40293d6c7a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:54.074875 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-e3855505-9e1b-4ba0-a593-0a40293d6c7a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:54.212972 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-e3855505-9e1b-4ba0-a593-0a40293d6c7a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:31:54.221152 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-e3855505-9e1b-4ba0-a593-0a40293d6c7a tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1453 microversion: 2.1 time: 0.161002 Jun 21 08:31:54.221709 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 592/1120] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:31:54 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:31:55.783744 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-8f898f85-3759-4ab1-92e6-ad6443802509 req-027bc4b7-c75d-4214-8f18-ef8a5cec8d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba37581-60a9-4add-9c41-f660406531d8", "tag": "2185d819-c44b-47b2-89fc-f7205c083a4e"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:31:55.792197 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-8f898f85-3759-4ab1-92e6-ad6443802509 req-027bc4b7-c75d-4214-8f18-ef8a5cec8d6b service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:31:55.792638 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-8f898f85-3759-4ab1-92e6-ad6443802509 req-027bc4b7-c75d-4214-8f18-ef8a5cec8d6b service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:31:55.803505 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-8f898f85-3759-4ab1-92e6-ad6443802509 req-027bc4b7-c75d-4214-8f18-ef8a5cec8d6b service nova] Creating event network-changed:2185d819-c44b-47b2-89fc-f7205c083a4e for instance 5ba37581-60a9-4add-9c41-f660406531d8 on hv-cinder-83697 Jun 21 08:31:55.808619 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-8f898f85-3759-4ab1-92e6-ad6443802509 req-027bc4b7-c75d-4214-8f18-ef8a5cec8d6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029482 Jun 21 08:31:55.809254 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 529/1121] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:32:07.746530 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:32:07.747173 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Tue Jun 21 08:32:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:32:16.703972 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:32:16.704559 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Tue Jun 21 08:32:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:33:35.537144 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:33:35.538303 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG dbcounter [-] [117547] Writing DB stats nova_cell1:SELECT=46 {{(pid=117547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:33:35.540336 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=20 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:33:35.541580 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=40 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:33:35.542608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-7a77d461-2af7-4f9d-a693-90852655c951 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:35.543148 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7a77d461-2af7-4f9d-a693-90852655c951 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:35.546707 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-8eaddd47-1e5c-4ac0-a00d-a226365d923e req-a7a7fbb9-32b7-41b1-a134-568283e3b213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba37581-60a9-4add-9c41-f660406531d8", "tag": "2185d819-c44b-47b2-89fc-f7205c083a4e"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:33:35.550338 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7a77d461-2af7-4f9d-a693-90852655c951 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:35.551348 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7a77d461-2af7-4f9d-a693-90852655c951 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:35.552237 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7a77d461-2af7-4f9d-a693-90852655c951 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:35.552660 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-7a77d461-2af7-4f9d-a693-90852655c951 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:35.557927 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-8eaddd47-1e5c-4ac0-a00d-a226365d923e req-a7a7fbb9-32b7-41b1-a134-568283e3b213 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:35.558411 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-8eaddd47-1e5c-4ac0-a00d-a226365d923e req-a7a7fbb9-32b7-41b1-a134-568283e3b213 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:35.571659 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-8eaddd47-1e5c-4ac0-a00d-a226365d923e req-a7a7fbb9-32b7-41b1-a134-568283e3b213 service nova] Creating event network-changed:2185d819-c44b-47b2-89fc-f7205c083a4e for instance 5ba37581-60a9-4add-9c41-f660406531d8 on hv-cinder-83697 Jun 21 08:33:35.578554 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-8eaddd47-1e5c-4ac0-a00d-a226365d923e req-a7a7fbb9-32b7-41b1-a134-568283e3b213 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039729 Jun 21 08:33:35.579540 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 530/1122] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 08:33:35.589989 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-7a77d461-2af7-4f9d-a693-90852655c951 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Going to try to terminate instance {{(pid=117547) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:33:35.678815 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-7a77d461-2af7-4f9d-a693-90852655c951 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 204 len: 0 microversion: 2.1 time: 0.143329 Jun 21 08:33:35.684396 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 593/1123] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:33:35 2022] DELETE /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:33:35.694143 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-636c75a6-58eb-45f2-9ffd-7a62e6584533 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:35.694989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-636c75a6-58eb-45f2-9ffd-7a62e6584533 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:35.701847 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-636c75a6-58eb-45f2-9ffd-7a62e6584533 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:35.703173 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-636c75a6-58eb-45f2-9ffd-7a62e6584533 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:35.703628 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-636c75a6-58eb-45f2-9ffd-7a62e6584533 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:35.704216 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-636c75a6-58eb-45f2-9ffd-7a62e6584533 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:35.876904 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-636c75a6-58eb-45f2-9ffd-7a62e6584533 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:33:35.884552 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-636c75a6-58eb-45f2-9ffd-7a62e6584533 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1578 microversion: 2.1 time: 0.196319 Jun 21 08:33:35.885123 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 531/1124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:33:35 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:33:36.902443 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a3beaf17-b85a-4c1a-8fdf-7a7ab4e932e1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:36.903345 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a3beaf17-b85a-4c1a-8fdf-7a7ab4e932e1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:36.910257 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a3beaf17-b85a-4c1a-8fdf-7a7ab4e932e1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:36.910885 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a3beaf17-b85a-4c1a-8fdf-7a7ab4e932e1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:36.912002 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a3beaf17-b85a-4c1a-8fdf-7a7ab4e932e1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:36.912481 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a3beaf17-b85a-4c1a-8fdf-7a7ab4e932e1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:37.048352 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a3beaf17-b85a-4c1a-8fdf-7a7ab4e932e1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:33:37.055973 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a3beaf17-b85a-4c1a-8fdf-7a7ab4e932e1 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1578 microversion: 2.1 time: 0.158374 Jun 21 08:33:37.056533 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 594/1125] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:33:36 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:33:37.677922 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-c06f84c9-a1db-4bde-a54b-05cf771ba67d req-ddd3ef4a-563a-4206-85b0-846969e81cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba37581-60a9-4add-9c41-f660406531d8", "name": "network-vif-deleted", "tag": "2185d819-c44b-47b2-89fc-f7205c083a4e"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:33:37.688903 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-c06f84c9-a1db-4bde-a54b-05cf771ba67d req-ddd3ef4a-563a-4206-85b0-846969e81cfa service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:37.689345 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-c06f84c9-a1db-4bde-a54b-05cf771ba67d req-ddd3ef4a-563a-4206-85b0-846969e81cfa service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:37.709663 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-c06f84c9-a1db-4bde-a54b-05cf771ba67d req-ddd3ef4a-563a-4206-85b0-846969e81cfa service nova] Creating event network-vif-deleted:2185d819-c44b-47b2-89fc-f7205c083a4e for instance 5ba37581-60a9-4add-9c41-f660406531d8 on hv-cinder-83697 Jun 21 08:33:37.715885 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-c06f84c9-a1db-4bde-a54b-05cf771ba67d req-ddd3ef4a-563a-4206-85b0-846969e81cfa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042073 Jun 21 08:33:37.716739 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 532/1126] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:33:38.072837 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:38.073455 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:38.080547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:38.080990 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:38.081754 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:38.082186 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:38.114758 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:38.115256 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:38.115701 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.objects.instance [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lazy-loading 'fault' on Instance uuid 5ba37581-60a9-4add-9c41-f660406531d8 {{(pid=117547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 08:33:38.155140 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:33:38.163588 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a12e1804-e2b7-425a-aeb4-263967b70e30 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 200 len: 1230 microversion: 2.1 time: 0.094733 Jun 21 08:33:38.164162 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 595/1127] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:33:38 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:33:39.184711 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8386fd4c-9bd0-4cfb-b4f3-0e1bbc953711 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:39.185405 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-8386fd4c-9bd0-4cfb-b4f3-0e1bbc953711 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5ba37581-60a9-4add-9c41-f660406531d8] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:39.191540 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8386fd4c-9bd0-4cfb-b4f3-0e1bbc953711 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:39.191981 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8386fd4c-9bd0-4cfb-b4f3-0e1bbc953711 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:39.193493 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8386fd4c-9bd0-4cfb-b4f3-0e1bbc953711 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:39.193920 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-8386fd4c-9bd0-4cfb-b4f3-0e1bbc953711 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:39.206951 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-8386fd4c-9bd0-4cfb-b4f3-0e1bbc953711 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] HTTP exception thrown: Instance 5ba37581-60a9-4add-9c41-f660406531d8 could not be found. Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8386fd4c-9bd0-4cfb-b4f3-0e1bbc953711 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Request method failure captured: Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 HTTP/1.1 Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisYDfJjTaUR207PCDqfr-b1CjvN0NJo1VZnCOFA3crwR3v4t7NvoTutpYtsz_jvyLp4Wwtk-1x4x8ZFQfOr1cgk9pWfXLnbs1jZVRxWast3E8guknN8i1JT3UpQ83IMgIPWGcps_OLLac8UY1TsgFOk4H0S6QjUPFwzs0nHsKbbamr-4 Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: b65afb27ab304161aaa6aabe73c1c58e Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:33:39.208719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b65afb27ab304161aaa6aabe73c1c58e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: b65afb27ab304161aaa6aabe73c1c58e Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-TestVolumeBootPattern-1242211373-project Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 7c428bd4817a40de8a378aa0935ae764 Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-TestVolumeBootPattern-1242211373-project Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 5ba37581-60a9-4add-9c41-f660406531d8 could not be found. Jun 21 08:33:39.210848 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '5ba37581-60a9-4add-9c41-f660406531d8'} Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba37581-60a9-4add-9c41-f660406531d8 could not be found. Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:33:39.211934 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba37581-60a9-4add-9c41-f660406531d8 could not be found. Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba37581-60a9-4add-9c41-f660406531d8 could not be found. Jun 21 08:33:39.213611 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:39.215487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-8386fd4c-9bd0-4cfb-b4f3-0e1bbc953711 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Returning 404 to user: Instance 5ba37581-60a9-4add-9c41-f660406531d8 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:33:39.215487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-8386fd4c-9bd0-4cfb-b4f3-0e1bbc953711 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8" status: 404 len: 111 microversion: 2.1 time: 0.030135 Jun 21 08:33:39.215487 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 533/1128] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:33:39 2022] GET /compute/v2.1/servers/5ba37581-60a9-4add-9c41-f660406531d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:33:42.283424 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-a9e5f0e0-8044-4532-9892-fea0ed2ea0f6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:42.284021 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a9e5f0e0-8044-4532-9892-fea0ed2ea0f6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:42.285288 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-6abdc277-f274-4824-b20c-de05ed8f7fdf req-b88aa269-69f3-4b06-8ff7-a75e28186d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a93ac5-4e57-4836-8b57-95728223391c", "tag": "39d9a614-e9a7-4ce7-bf0f-995b5ce17ecf"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:33:42.292140 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a9e5f0e0-8044-4532-9892-fea0ed2ea0f6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:42.292935 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a9e5f0e0-8044-4532-9892-fea0ed2ea0f6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:42.293910 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a9e5f0e0-8044-4532-9892-fea0ed2ea0f6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:42.294347 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-a9e5f0e0-8044-4532-9892-fea0ed2ea0f6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:42.294606 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-6abdc277-f274-4824-b20c-de05ed8f7fdf req-b88aa269-69f3-4b06-8ff7-a75e28186d32 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:42.295095 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-6abdc277-f274-4824-b20c-de05ed8f7fdf req-b88aa269-69f3-4b06-8ff7-a75e28186d32 service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:42.306540 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-6abdc277-f274-4824-b20c-de05ed8f7fdf req-b88aa269-69f3-4b06-8ff7-a75e28186d32 service nova] Creating event network-changed:39d9a614-e9a7-4ce7-bf0f-995b5ce17ecf for instance 29a93ac5-4e57-4836-8b57-95728223391c on hv-cinder-83697 Jun 21 08:33:42.311986 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-6abdc277-f274-4824-b20c-de05ed8f7fdf req-b88aa269-69f3-4b06-8ff7-a75e28186d32 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030757 Jun 21 08:33:42.312989 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 534/1129] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:33:42.325220 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-a9e5f0e0-8044-4532-9892-fea0ed2ea0f6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Going to try to terminate instance {{(pid=117547) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 08:33:42.428612 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-a9e5f0e0-8044-4532-9892-fea0ed2ea0f6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "DELETE /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 204 len: 0 microversion: 2.1 time: 0.149288 Jun 21 08:33:42.429653 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 596/1130] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:33:42 2022] DELETE /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 08:33:42.437933 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d3832248-2252-4487-ace7-51adc8cb47ea tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:42.438657 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-d3832248-2252-4487-ace7-51adc8cb47ea tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:42.447593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3832248-2252-4487-ace7-51adc8cb47ea tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:42.447593 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3832248-2252-4487-ace7-51adc8cb47ea tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:42.448613 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3832248-2252-4487-ace7-51adc8cb47ea tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:42.449247 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-d3832248-2252-4487-ace7-51adc8cb47ea tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:42.597092 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.policy [None req-d3832248-2252-4487-ace7-51adc8cb47ea tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117548) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:33:42.604962 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d3832248-2252-4487-ace7-51adc8cb47ea tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1577 microversion: 2.1 time: 0.171191 Jun 21 08:33:42.605751 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 535/1131] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:33:42 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:33:43.622338 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-f0d49fba-ea5a-4760-aea8-83195ecd49f4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:43.623184 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-f0d49fba-ea5a-4760-aea8-83195ecd49f4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:43.629772 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f0d49fba-ea5a-4760-aea8-83195ecd49f4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:43.630294 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f0d49fba-ea5a-4760-aea8-83195ecd49f4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:43.631183 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f0d49fba-ea5a-4760-aea8-83195ecd49f4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:43.631608 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-f0d49fba-ea5a-4760-aea8-83195ecd49f4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:43.786938 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-f0d49fba-ea5a-4760-aea8-83195ecd49f4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:33:43.798059 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-f0d49fba-ea5a-4760-aea8-83195ecd49f4 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1577 microversion: 2.1 time: 0.179828 Jun 21 08:33:43.799464 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 597/1132] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:33:43 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 08:33:44.636476 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [req-c1dba48a-4616-4bce-9205-468fea8fe279 req-b03dbc8c-fb39-489d-a10f-f48f85cbc21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a93ac5-4e57-4836-8b57-95728223391c", "name": "network-vif-deleted", "tag": "39d9a614-e9a7-4ce7-bf0f-995b5ce17ecf"}]} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 08:33:44.645269 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-c1dba48a-4616-4bce-9205-468fea8fe279 req-b03dbc8c-fb39-489d-a10f-f48f85cbc21a service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:44.645705 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [req-c1dba48a-4616-4bce-9205-468fea8fe279 req-b03dbc8c-fb39-489d-a10f-f48f85cbc21a service nova] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:44.659024 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.compute.server_external_events [req-c1dba48a-4616-4bce-9205-468fea8fe279 req-b03dbc8c-fb39-489d-a10f-f48f85cbc21a service nova] Creating event network-vif-deleted:39d9a614-e9a7-4ce7-bf0f-995b5ce17ecf for instance 29a93ac5-4e57-4836-8b57-95728223391c on hv-cinder-83697 Jun 21 08:33:44.664462 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [req-c1dba48a-4616-4bce-9205-468fea8fe279 req-b03dbc8c-fb39-489d-a10f-f48f85cbc21a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031605 Jun 21 08:33:44.665093 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 536/1133] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 08:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 08:33:44.823632 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-9c6dfdd6-ca97-4381-a5ba-4500a91e4a70 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:44.824200 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-9c6dfdd6-ca97-4381-a5ba-4500a91e4a70 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:44.830298 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c6dfdd6-ca97-4381-a5ba-4500a91e4a70 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:44.830852 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c6dfdd6-ca97-4381-a5ba-4500a91e4a70 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:44.831614 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c6dfdd6-ca97-4381-a5ba-4500a91e4a70 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:44.832043 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-9c6dfdd6-ca97-4381-a5ba-4500a91e4a70 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:44.909908 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.policy [None req-9c6dfdd6-ca97-4381-a5ba-4500a91e4a70 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c428bd4817a40de8a378aa0935ae764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65afb27ab304161aaa6aabe73c1c58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117547) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 08:33:44.918547 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-9c6dfdd6-ca97-4381-a5ba-4500a91e4a70 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 200 len: 1225 microversion: 2.1 time: 0.099537 Jun 21 08:33:44.927952 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 598/1134] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:33:44 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 08:33:45.937151 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1b11b229-29d7-46cb-8f0a-f4f91bb1326b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:45.937735 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-1b11b229-29d7-46cb-8f0a-f4f91bb1326b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 29a93ac5-4e57-4836-8b57-95728223391c] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:45.944764 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1b11b229-29d7-46cb-8f0a-f4f91bb1326b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:45.945367 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1b11b229-29d7-46cb-8f0a-f4f91bb1326b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:45.946145 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1b11b229-29d7-46cb-8f0a-f4f91bb1326b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:45.946571 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-1b11b229-29d7-46cb-8f0a-f4f91bb1326b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:45.961215 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-1b11b229-29d7-46cb-8f0a-f4f91bb1326b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] HTTP exception thrown: Instance 29a93ac5-4e57-4836-8b57-95728223391c could not be found. Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1b11b229-29d7-46cb-8f0a-f4f91bb1326b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Request method failure captured: Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c HTTP/1.1 Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisYDfJjTaUR207PCDqfr-b1CjvN0NJo1VZnCOFA3crwR3v4t7NvoTutpYtsz_jvyLp4Wwtk-1x4x8ZFQfOr1cgk9pWfXLnbs1jZVRxWast3E8guknN8i1JT3UpQ83IMgIPWGcps_OLLac8UY1TsgFOk4H0S6QjUPFwzs0nHsKbbamr-4 Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: b65afb27ab304161aaa6aabe73c1c58e Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:33:45.962902 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b65afb27ab304161aaa6aabe73c1c58e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: b65afb27ab304161aaa6aabe73c1c58e Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-TestVolumeBootPattern-1242211373-project Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 7c428bd4817a40de8a378aa0935ae764 Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-TestVolumeBootPattern-1242211373-project Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 29a93ac5-4e57-4836-8b57-95728223391c could not be found. Jun 21 08:33:45.964926 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '29a93ac5-4e57-4836-8b57-95728223391c'} Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a93ac5-4e57-4836-8b57-95728223391c could not be found. Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:33:45.966180 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a93ac5-4e57-4836-8b57-95728223391c could not be found. Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a93ac5-4e57-4836-8b57-95728223391c could not be found. Jun 21 08:33:45.968185 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:45.970032 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-1b11b229-29d7-46cb-8f0a-f4f91bb1326b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Returning 404 to user: Instance 29a93ac5-4e57-4836-8b57-95728223391c could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:33:45.970032 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-1b11b229-29d7-46cb-8f0a-f4f91bb1326b tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c" status: 404 len: 111 microversion: 2.1 time: 0.032234 Jun 21 08:33:45.970032 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 537/1135] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:33:45 2022] GET /compute/v2.1/servers/29a93ac5-4e57-4836-8b57-95728223391c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:33:46.450649 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-da180145-029e-4312-ba4c-c36a53af40c6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:46.451423 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.compute.api [None req-da180145-029e-4312-ba4c-c36a53af40c6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117547) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:46.457842 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-da180145-029e-4312-ba4c-c36a53af40c6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:46.458290 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-da180145-029e-4312-ba4c-c36a53af40c6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:46.459083 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-da180145-029e-4312-ba4c-c36a53af40c6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:46.459521 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG oslo_concurrency.lockutils [None req-da180145-029e-4312-ba4c-c36a53af40c6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:46.473733 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.wsgi [None req-da180145-029e-4312-ba4c-c36a53af40c6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] HTTP exception thrown: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-da180145-029e-4312-ba4c-c36a53af40c6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Request method failure captured: Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: request: DELETE /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 HTTP/1.1 Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept: application/json Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Accept-Encoding: identity Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Connection: close Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Length: 0 Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Content-Type: application/json Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Host: 10.222.0.36 Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Openstack-System-Scope: None Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: User-Agent: python-urllib3/1.26.9 Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Auth-Token: gAAAAABisYDfJjTaUR207PCDqfr-b1CjvN0NJo1VZnCOFA3crwR3v4t7NvoTutpYtsz_jvyLp4Wwtk-1x4x8ZFQfOr1cgk9pWfXLnbs1jZVRxWast3E8guknN8i1JT3UpQ83IMgIPWGcps_OLLac8UY1TsgFOk4H0S6QjUPFwzs0nHsKbbamr-4 Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Id: None Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Domain-Name: None Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Identity-Status: Confirmed Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Is-Admin-Project: True Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Id: default Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Domain-Name: Default Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Id: b65afb27ab304161aaa6aabe73c1c58e Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Project-Name: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Role: reader,member Jun 21 08:33:46.475473 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Roles: reader,member Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b65afb27ab304161aaa6aabe73c1c58e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Id: b65afb27ab304161aaa6aabe73c1c58e Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-Tenant-Name: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User: tempest-TestVolumeBootPattern-1242211373-project Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Id: default Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Domain-Name: Default Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Id: 7c428bd4817a40de8a378aa0935ae764 Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: X-User-Name: tempest-TestVolumeBootPattern-1242211373-project Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: method: > Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: exception: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:33:46.478766 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: action_args: {'id': '5158b74b-28fa-4edc-b88e-ec99a87d0416'} Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:33:46.480719 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:33:46.482537 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: ERROR nova.api.openstack.wsgi Jun 21 08:33:46.484207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-da180145-029e-4312-ba4c-c36a53af40c6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Returning 404 to user: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. {{(pid=117547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:33:46.484207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-da180145-029e-4312-ba4c-c36a53af40c6 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 404 len: 111 microversion: 2.1 time: 0.030299 Jun 21 08:33:46.484207 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 599/1136] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 08:33:46 2022] DELETE /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:33:46.486603 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c96dcda0-2074-49d4-b18d-2d4adefd9477 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:46.487779 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.compute.api [None req-c96dcda0-2074-49d4-b18d-2d4adefd9477 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] [instance: 5158b74b-28fa-4edc-b88e-ec99a87d0416] Fetching instance by UUID {{(pid=117548) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 08:33:46.496668 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c96dcda0-2074-49d4-b18d-2d4adefd9477 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:46.497120 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c96dcda0-2074-49d4-b18d-2d4adefd9477 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:46.498108 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c96dcda0-2074-49d4-b18d-2d4adefd9477 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 08:33:46.498968 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-c96dcda0-2074-49d4-b18d-2d4adefd9477 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Lock "2ad5ffcf-142b-4048-bb9c-97a48bfdc94c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 08:33:46.515361 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-c96dcda0-2074-49d4-b18d-2d4adefd9477 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] HTTP exception thrown: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c96dcda0-2074-49d4-b18d-2d4adefd9477 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Request method failure captured: Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 HTTP/1.1 Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept: application/json Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Accept-Encoding: identity Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Connection: close Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Length: 0 Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Content-Type: application/json Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: User-Agent: python-urllib3/1.26.9 Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABisYDfJjTaUR207PCDqfr-b1CjvN0NJo1VZnCOFA3crwR3v4t7NvoTutpYtsz_jvyLp4Wwtk-1x4x8ZFQfOr1cgk9pWfXLnbs1jZVRxWast3E8guknN8i1JT3UpQ83IMgIPWGcps_OLLac8UY1TsgFOk4H0S6QjUPFwzs0nHsKbbamr-4 Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Id: b65afb27ab304161aaa6aabe73c1c58e Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Project-Name: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Role: reader,member Jun 21 08:33:46.516830 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Roles: reader,member Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b65afb27ab304161aaa6aabe73c1c58e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b65afb27ab304161aaa6aabe73c1c58e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Id: b65afb27ab304161aaa6aabe73c1c58e Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-Tenant-Name: tempest-TestVolumeBootPattern-1242211373 Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User: tempest-TestVolumeBootPattern-1242211373-project Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Id: 7c428bd4817a40de8a378aa0935ae764 Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: X-User-Name: tempest-TestVolumeBootPattern-1242211373-project Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: method: > Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: exception: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:33:46.519305 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: action_args: {'id': '5158b74b-28fa-4edc-b88e-ec99a87d0416'} Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 08:33:46.520508 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. Jun 21 08:33:46.522410 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Jun 21 08:33:46.524719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c96dcda0-2074-49d4-b18d-2d4adefd9477 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Returning 404 to user: Instance 5158b74b-28fa-4edc-b88e-ec99a87d0416 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 08:33:46.524719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c96dcda0-2074-49d4-b18d-2d4adefd9477 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416" status: 404 len: 111 microversion: 2.1 time: 0.036456 Jun 21 08:33:46.524719 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 538/1137] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 08:33:46 2022] GET /compute/v2.1/servers/5158b74b-28fa-4edc-b88e-ec99a87d0416 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 08:33:47.829312 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: DEBUG nova.api.openstack.wsgi [None req-208014a6-c87c-4550-b440-edc938bba736 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] Calling method '.version_select at 0x7fded81df700>' {{(pid=117547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 08:33:47.856390 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO nova.api.openstack.requestlog [None req-208014a6-c87c-4550-b440-edc938bba736 tempest-TestVolumeBootPattern-1242211373 tempest-TestVolumeBootPattern-1242211373-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-971519085" status: 202 len: 0 microversion: 2.1 time: 0.033026 Jun 21 08:33:47.856983 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: [pid: 117547|app: 0|req: 600/1138] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Jun 21 08:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-971519085 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 08:33:52.358866 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:33:52.359486 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Tue Jun 21 08:33:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:35:36.712178 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:35:36.713006 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Tue Jun 21 08:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:35:50.925138 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:35:50.925760 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Tue Jun 21 08:35:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:36:00.081105 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:36:00.081694 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Tue Jun 21 08:36:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:37:07.757378 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:37:07.758010 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Tue Jun 21 08:37:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:37:12.368865 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:37:12.369484 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Tue Jun 21 08:37:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:37:16.335540 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:37:16.336272 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Tue Jun 21 08:37:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:38:56.720948 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:38:56.721591 dv-cinder-836973-7-iscsi devstack@n-api.service[117548]: Tue Jun 21 08:38:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 08:39:10.933533 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 08:39:10.934091 dv-cinder-836973-7-iscsi devstack@n-api.service[117547]: Tue Jun 21 08:39:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!